You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/05/02 17:28:05 UTC
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #26
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/26/display/redirect?page=changes>
Changes:
[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit
[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)
[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)
------------------------------------------
[...truncated 23.50 KB...]
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.39.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.44.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2737178 sha256=2243ee5a7ab277c4286af541902ff494a36be6c40d872a073b821aa97465676f
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.4 botocore-1.25.4 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:559 Starting the size estimation of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:572 Finished listing 10 files in 0.047762155532836914 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:559 Starting the size estimation of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:572 Finished listing 1 files in 0.041213035583496094 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 33.26 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 39s
15 actionable tasks: 13 executed, 1 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/qg3q2wsfihqr6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #276
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/276/display/redirect>
Changes:
------------------------------------------
[...truncated 18.49 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.22-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (63.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=597231e1f4154eef7ce9b84a6fefc4bfecc56629781fadc8981424ed3bed8f85
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.6 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.75 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 27s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3nqjbd4fpm3hk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #275
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/275/display/redirect?page=changes>
Changes:
[noreply] Go SDK: Update memfs to parse the List() pattern as a glob, not a regexp
[noreply] Bump cloud.google.com/go/pubsub from 1.23.0 to 1.23.1 in /sdks (#22122)
------------------------------------------
[...truncated 18.50 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.2-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.22-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (63.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=4ba7c7cc0e13d893e26f5ff56b4ad56d279bc7517e50bdadb9909fea3db1374c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.6 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.99 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 32s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rrpxnzddmhutm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #274
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/274/display/redirect>
Changes:
------------------------------------------
[...truncated 18.56 KB...]
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.22-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=b3538b8d37a4930ff87fce186f1f5417ff7097ffd7cd37aff5eb8e3882497d80
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.6 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.89 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 33s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/owflwpfv7c6si
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #273
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/273/display/redirect>
Changes:
------------------------------------------
[...truncated 18.62 KB...]
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=c4a30e0f914116c4e340bdcfd7c9cbcd6d516b6fecde84e4d213da14117b1ade
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.6 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.53 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 33s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4hpf2zyfqofig
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #272
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/272/display/redirect>
Changes:
------------------------------------------
[...truncated 18.60 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.2-py3-none-any.whl (178 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.22-py3-none-any.whl (132 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=62b478aba343d469da5e7e104c32c24d69b2cf329505b2e105e2a5e985c5622f
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 18.50 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ysi4nagvll4cg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #271
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/271/display/redirect>
Changes:
------------------------------------------
[...truncated 18.53 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.22-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=8a7bd7ee1862f1debc7deae0ce795c4ebc04a61509b5f37ca56171b6a18e9b9f
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.24 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 32s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wkkystl66echq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #270
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/270/display/redirect?page=changes>
Changes:
[noreply] Sharding IO tests(amazon web services and amazon web services 2) from
------------------------------------------
[...truncated 18.52 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.2-py3-none-any.whl (178 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.22-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=1872f22b517955f2e495f2f4385247c0416829723f119f1ae2a767a3a94d950d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.59 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 33s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3732g7va2j6si
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #269
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/269/display/redirect>
Changes:
------------------------------------------
[...truncated 18.47 KB...]
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=2758c45802050af2369e4dd6446ac6bd2a5952d27f208098a8ee08c6dc43c53a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.99 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ycwbfq2sjwd74
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #268
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/268/display/redirect>
Changes:
------------------------------------------
[...truncated 18.47 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.22-py3-none-any.whl (132 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.2-py3-none-any.whl (178 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=6a8ab8522133c80b84d74973cdb8310ceb42799afedee8225f03f148602ca054
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 18.68 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ywvnku2pde5x2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #267
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/267/display/redirect>
Changes:
------------------------------------------
[...truncated 18.51 KB...]
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.2-py3-none-any.whl (178 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=5fc7b5f502f51b8af883a5bf53447065415cda052cbb45c7ac9434d7aaf65eb1
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.28 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zbakajuwha2ps
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #266
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/266/display/redirect?page=changes>
Changes:
[noreply] Python: Use RowTypeConstraint for normalizing all schema-inferrable user
[noreply] changing nameBase value to Java_GCP_IO_Direct (#22128)
[noreply] Bump dataflow fnapi java sdk version (#22127)
------------------------------------------
[...truncated 18.53 KB...]
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.2-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.22
Using cached botocore-1.27.22-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2816565 sha256=01b2fb19af259ef975fe0849c4928269c61a34240b8fb0378f9aed4043f2b826
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.22 botocore-1.27.22 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 53.21 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 40s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dzyojknwimsvk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #265
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/265/display/redirect>
Changes:
------------------------------------------
[...truncated 18.48 KB...]
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.21
Using cached botocore-1.27.21-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2814949 sha256=e74eddf15b7804b18e37fc95e9bf697c77cfc57fd96819648f4155c678992a9e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.21 botocore-1.27.21 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.3.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.84 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 32s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6vh76nf7znhsu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #264
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/264/display/redirect?page=changes>
Changes:
[Moritz Mack] Deprecate runner support for Spark 2.4 (closes #22094)
------------------------------------------
[...truncated 18.56 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.2-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.21-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.21
Using cached botocore-1.27.21-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2814949 sha256=1206c19cbd235a2d19a2a9bf189f2fe441d41bec1094570411fea63149b150ad
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.21 botocore-1.27.21 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.01 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4ha6n444gerza
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #263
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/263/display/redirect?page=changes>
Changes:
[noreply] Fix #21977: Add Search transform to Go FhirIO (#21979)
------------------------------------------
[...truncated 18.48 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.21-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.21
Using cached botocore-1.27.21-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2814949 sha256=0d13549a27fc2a7c5bc999fe02dd9cdf6d09d4e9c2081fbd0413b2bb810ee67e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.21 botocore-1.27.21 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.12 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 30s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/whmtde4vqz3l2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #262
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/262/display/redirect?page=changes>
Changes:
[alexey.inkin] Do not re-create PlaygroundState (#21950)
[noreply] Change default, options, and explanation for issue priority (#22116)
[noreply] Minor: Bump flake8 to 4.0.1 (#22110)
[noreply] Add sdk_harness_log_level_overrides option for python sdk (#22077)
[noreply] Fix typo in Pytorch Bert Language Modeling (#22114)
------------------------------------------
[...truncated 18.55 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.2-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.21-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.21
Using cached botocore-1.27.21-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (442 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2814949 sha256=f42b292b0b0e0c3641b365f1d2799154e388988b43bcb5472499ad0307ac9b69
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.2 azure-storage-blob-12.12.0 boto3-1.24.21 botocore-1.27.21 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.60 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 29s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/cdcfooinpmkgy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #261
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/261/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14187] Fix NPE at initializeForKeyedRead in IsmReaderImpl (#22111)
[noreply] Remove unused legacy dataflow translate code (#22019)
[noreply] Fixes #21698: Use normal Container snapshots for Go Load Tests (#22102)
------------------------------------------
[...truncated 18.50 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.20-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.20
Using cached botocore-1.27.20-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813787 sha256=cd8f4604e4d8fbdec52a66594d7daed749165df6c46adc5ecce245fdd6f4a6af
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.20 botocore-1.27.20 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.00 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 32s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/np2mervn5j5aw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #260
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/260/display/redirect>
Changes:
------------------------------------------
[...truncated 18.59 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.20-py3-none-any.whl (132 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.20
Using cached botocore-1.27.20-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813787 sha256=5667cf68c2c4288ccdf833c4cc2ef91affd30f879238634109cfaace0430542a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.20 botocore-1.27.20 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.15 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/h43hhs3hvu7bc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #259
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/259/display/redirect>
Changes:
------------------------------------------
[...truncated 18.53 KB...]
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.20-py3-none-any.whl (132 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.20
Using cached botocore-1.27.20-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813787 sha256=d431c6cf01b87871ebc634b59503ee14de3e8d9571eb2baae054cfd41617f04d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.20 botocore-1.27.20 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.66 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 33s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/n2ym7jldcsgce
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #258
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/258/display/redirect?page=changes>
Changes:
[alexey.inkin] Add an abstract layer for analytics, fix logging change of snippet, fix
[noreply] Add FlatMap(<builtin>) known issue to 2.40.0 blog (#22101)
[noreply] [BEAM-14347] Update docs to prefer generic registration functions
[Andrew Pilloud] Projection Pushdown optimizer on by default
[noreply] Merge pull request #21752 from Feature/beam 13852 reimplement with
[noreply] Change wording of Pytorch LM example (#22099)
[noreply] Fix missing model_params in Pytorch docstring (#22100)
[noreply] Test and fix FlatMap(<builtin>) issue (#22104)
[noreply] Fix InputStream on platform with 4 bytie long (#22107)
------------------------------------------
[...truncated 18.50 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.20-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.20
Using cached botocore-1.27.20-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813787 sha256=7fd1289601540e3df05deb860b9ec47efcd7c77c66df8daa3711fb1d46cb8ecb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.20 botocore-1.27.20 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 20.02 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 44s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/eyoqbpalzcwyi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #257
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/257/display/redirect?page=changes>
Changes:
[bulat.safiullin] [Website] add scroll-spy to body in case-studies/baseof.html
[noreply] remove mention of dill in release notes as it's not relevant. (#22087)
[noreply] [#21634] Add comments on FieldValueGetter. (#21982)
[noreply] Bump google.golang.org/api from 0.85.0 to 0.86.0 in /sdks (#22092)
[noreply] [BEAM-6597] Replace ProgressRequestCallback with BundleProgressReporter
[noreply] [Go SDK] Go Lint fixes (#21967)
[noreply] Fix #21869: Close GRPC connections on cancel (#21874)
------------------------------------------
[...truncated 18.66 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.19-py3-none-any.whl (132 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.9.0-py2.py3-none-any.whl (167 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.19
Using cached botocore-1.27.19-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer<3,>=2
Downloading charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=a3e2fb826a3986b7b7d8c696517058f5634687f20a7f05f4c859d0107f4d3d22
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.19 botocore-1.27.19 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.1.0 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.11 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 49s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jl7ekdazqxgvi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #256
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/256/display/redirect>
Changes:
------------------------------------------
[...truncated 18.66 KB...]
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.19
Using cached botocore-1.27.19-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=c8051e107997710eb0105103f6f8e1f9f06a7cff7e8057f20cb24da3e9b6e1eb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.19 botocore-1.27.19 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.64 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 29s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rah2jyr5a3xkm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #255
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/255/display/redirect?page=changes>
Changes:
[damondouglas] Implement PubsubSchemaTransformMessageToFactory
[noreply] Bump cloud.google.com/go/storage from 1.22.1 to 1.23.0 in /sdks (#22038)
[noreply] Followup sharding javaPostCommit (#22081)
------------------------------------------
[...truncated 18.49 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.19-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.19
Using cached botocore-1.27.19-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=23dbccc3f3921fc18fb49e818bcb4a520d00d2ae6222e03d8fe8e5fdba92bf96
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.19 botocore-1.27.19 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 33.69 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 49s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hadurvej6ttme
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #254
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/254/display/redirect?page=changes>
Changes:
[noreply] Update issue bot to javascript and add label management (#22067)
[noreply] Clean up issue management doc page
[noreply] [BEAM-13015, #21250, fixes #22053] Improve PCollectionConsumerRegistry
[noreply] sharding GCP IO tests from the javaPostCommit task (#21800)
------------------------------------------
[...truncated 18.43 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.18-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.18
Using cached botocore-1.27.18-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=fcb6df83a70389e6223ff7562a9b1761c37f54a93f239d79e523e7d6e06395d5
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.18 botocore-1.27.18 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.91 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 21s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tzc5xylmndbd2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #253
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/253/display/redirect>
Changes:
------------------------------------------
[...truncated 18.47 KB...]
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.18
Using cached botocore-1.27.18-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=b6e986edfaff0e38daa751334fc54bd151f21a57cdf89033c947ae1879418e01
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.18 botocore-1.27.18 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.20 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dclraghyjpjvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #252
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/252/display/redirect>
Changes:
------------------------------------------
[...truncated 18.63 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.18-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.18
Using cached botocore-1.27.18-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=2837e8871b3107cb7fb5c7eb9e2f0438e4dd0e0ae327c3a82bd0080794a826a9
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.18 botocore-1.27.18 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.5 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.85 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 32s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jzukccliz6gj2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #251
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/251/display/redirect?page=changes>
Changes:
[Pablo Estrada] Blog post and updates for release 2.40.0
[noreply] Add randomness to integration test job names to avoid collisions
[noreply] Give @pcoet triage permission (#22068)
[noreply] Issue#20877 Updated Interactive Beam README (#22034)
------------------------------------------
[...truncated 18.46 KB...]
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.18
Using cached botocore-1.27.18-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=6ea486f17b7d16a0640109d2df44c586793f29806dd70738c575283c0f9606d3
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.18 botocore-1.27.18 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.92 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 21s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lz24tudrkytyk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #250
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/250/display/redirect?page=changes>
Changes:
[noreply] 22011 remove checks on client.close() except when
[noreply] update flutter version to 3.0.1-stable (#22062)
------------------------------------------
[...truncated 18.64 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.17-py3-none-any.whl (132 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=7baa51a58823ee7cb8985a2252a3b130c7162b0f02ba8d7ef69fc7de778b4e6d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.2 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.34 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 22s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/npy5zir4bqmxm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #249
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/249/display/redirect>
Changes:
------------------------------------------
[...truncated 18.40 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.17-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=0e69692b2ede4a9fdab5a857f1082266b6a53d7dfc91442a92cb7f2dd60a3fcf
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.90 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wb6idgcc7camg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #248
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/248/display/redirect>
Changes:
------------------------------------------
[...truncated 18.39 KB...]
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=fc24beb82454a9dbd3083e5ae7f19ca9a476de45503e5a39c4b5954bd41c247d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 16.87 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 22s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6iuwlrkxkzd2s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #247
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/247/display/redirect>
Changes:
------------------------------------------
[...truncated 18.52 KB...]
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=6fd8cd574c50077fb88f26a58b046bbdebb4f9f21a9e551989ee670616eea622
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 30.61 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 9s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vdv5u4kxveqek
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #246
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/246/display/redirect>
Changes:
------------------------------------------
[...truncated 18.34 KB...]
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=c4b95a885c6ea2f9641d76a1e03d91fae7120ffaed94fc37293c2e1bcaa77606
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 20.61 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 33s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i2n6tl62hkb62
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #245
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/245/display/redirect>
Changes:
------------------------------------------
[...truncated 18.47 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.17-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=a4bc720ce8b675da52a8ce901c7b666315f94796be52066cbc050279a50a845e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.85 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/l7yxuwadx6hsg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #244
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/244/display/redirect>
Changes:
------------------------------------------
[...truncated 18.39 KB...]
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=5c7f6374ec3933e7aefdf6cac561fa7d07e0e0926f979c1e641c2a4ee4678fc8
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.50 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 29s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mvvnaaumqhqly
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #243
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/243/display/redirect>
Changes:
------------------------------------------
[...truncated 18.40 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.17-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=1785d739245ab45d5834da292295d4f6c052bb0a331b10123b0b22a42525478d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 21.83 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 34s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wjqe3gz6qcrc4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #242
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/242/display/redirect>
Changes:
------------------------------------------
[...truncated 18.38 KB...]
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=9da2d8b1b16e31937d3ee9c486ea8db7c09b01d37adebe6109fd160a86eb0772
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.38 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 30s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gluxaju4sgdwg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #241
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/241/display/redirect>
Changes:
------------------------------------------
[...truncated 18.47 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.17-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=fe3f7fd92eb23a990dfd4aace9d3085316bbdab970941d9346e268f398e58463
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.59 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 30s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5t7nwevdixawg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #240
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/240/display/redirect?page=changes>
Changes:
[noreply] Fix SpannerIO flakes (#22023)
------------------------------------------
[...truncated 18.34 KB...]
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=5b111e7e07db743983024b8b327167c8cc9f034ba0b4061dd1f3ab3ce8cd60f6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 18.75 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 30s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sbhzjn5jjm4qy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #239
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/239/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Use WindowedValue.withValue rather than WindowedValue.of in
[Robert Bradshaw] [BEAM-14464] More efficient grouping keys in precombiner table.
[Robert Bradshaw] fix compile after merge
[Robert Bradshaw] spotless
[Robert Bradshaw] Only flush every Nth element.
[Robert Bradshaw] spotless
[Robert Bradshaw] Post-merge fix.
[Robert Bradshaw] Fix test expectations.
[bulat.safiullin] [Website] add guard expressions to fix-menu and page-nav
[noreply] Remove colon in issue report
[noreply] Bump cloud.google.com/go/pubsub from 1.22.2 to 1.23.0 in /sdks (#22036)
[noreply] Fix vendored dependency issue and other style checks (#22046)
[noreply] Bump shell-quote (#21983)
[noreply] Revert "[BEAM-13590]Update Pytest version to support Python 3.10
[noreply] Bump cloud.google.com/go/bigquery from 1.32.0 to 1.34.1 in /sdks
[noreply] Bump github.com/spf13/cobra from 1.4.0 to 1.5.0 in /sdks (#21955)
[yathu] checkStlye Fix: remove redundant static and public in interface. camel
[noreply] Fix DEADLINE_EXCEEDED flakiness (#22035)
------------------------------------------
[...truncated 18.56 KB...]
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.17
Using cached botocore-1.27.17-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=21e5ff5768244fae6f21b65363a32bf80b319a012f93fcb4ac6af101be4994d4
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.17 botocore-1.27.17 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.65 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 34s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uwcfzo26dtjle
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #238
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/238/display/redirect?page=changes>
Changes:
[noreply] Enable close issue as not planned (#22032)
[noreply] Rename README.md to ACTIONS.md (#22043)
[noreply] Removes examples of unscalable sinks from documentation. (#22020)
[noreply] Unify to a single issue report (#22045)
------------------------------------------
[...truncated 18.91 KB...]
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Downloading SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 23.4 MB/s eta 0:00:00
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.16-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.16
Using cached botocore-1.27.16-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=7c80b394d4e9d43af0f595c06bd00b10d685877d4c744e0c463dd25644130a7d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.16 botocore-1.27.16 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.39 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 12.15s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 34s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6mltcou4jiwmi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #237
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/237/display/redirect>
Changes:
------------------------------------------
[...truncated 18.85 KB...]
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.38-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.16-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.16
Using cached botocore-1.27.16-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=947e85fd898ba285159e9e2e492761ee86f67b4aa34d431a54690bea22b60f0e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.16 botocore-1.27.16 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.38 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 11.46s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 34s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5egx5mvfbwsde
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #236
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/236/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #21953 from Implement
------------------------------------------
[...truncated 18.83 KB...]
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.38-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.16-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.16
Using cached botocore-1.27.16-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=f3bc0569fc8719843b6cb76cc99b400fed591b538b52fe4505efa9fba2d7d667
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.16 botocore-1.27.16 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.38 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 9.94s[0m[33m ========================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 21s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/s4jwsgzly2hag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #235
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/235/display/redirect?page=changes>
Changes:
[noreply] Canonicalize standard_coders.yaml booleans
[noreply] Followup fix FileIOTest.testMatchWatchForNewFiles flaky (#21877)
[noreply] Fix links for issue report (#22033)
------------------------------------------
[...truncated 18.79 KB...]
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.16-py3-none-any.whl (132 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.9.0,>=0.7.1
Using cached parameterized-0.8.1-py2.py3-none-any.whl (26 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.38-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.16
Using cached botocore-1.27.16-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813574 sha256=4d2d674011703ac5cb0605e9617c2fdc60e9b4a133af0edfacc653a5ea57317f
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.16 botocore-1.27.16 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.38 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 12.63s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 21s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/n56hkh22yvi2y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #234
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/234/display/redirect?page=changes>
Changes:
[andyye333] Move wrapper class outside run()
[noreply] Fix issues with test ordering (#21986)
------------------------------------------
[...truncated 18.81 KB...]
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.38-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.15-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.15
Using cached botocore-1.27.15-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813579 sha256=28b3a16d753234fae96ee92a8b91889d75779f8485f09b1e5bf0b334dadc629a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.15 botocore-1.27.15 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.3 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.38 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 21.08s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 27s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/q7j7ua65dqkac
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #233
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/233/display/redirect>
Changes:
------------------------------------------
[...truncated 18.80 KB...]
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.15-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.15
Using cached botocore-1.27.15-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813561 sha256=42e0d3fb57f9297f4ee373b2359a171f855a40de2a5b86371fb0fdd707e3a7c4
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.15 botocore-1.27.15 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.2 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 9.47s[0m[33m ========================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 28s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/euc2r3k7573d6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #232
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/232/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Streaming-related runner fixes.
[Robert Bradshaw] Improvements to auto-started services.
[Robert Bradshaw] Fix version, asserts for remote execution.
[Robert Bradshaw] Add IO dependencies.
[Robert Bradshaw] Add several cross-language IOs.
[Robert Bradshaw] Disable tests that require new release is required for out-of-the-box
[rszper] Correcting the regex for the Dataflow job name.
[noreply] Fix FlatMap numpy array bug (#22006)
[Robert Bradshaw] More strongly typed outputs.
------------------------------------------
[...truncated 18.78 KB...]
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.15
Using cached botocore-1.27.15-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813561 sha256=6f30e7eaf286c1bc1befcabad62ac86a3aa2b1995d35f30f366149e772ea872a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.15 botocore-1.27.15 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.3 overrides-6.1.0 pandas-1.4.2 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 10.01s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 28s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2nal3embwrxoc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #231
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/231/display/redirect?page=changes>
Changes:
[noreply] Clean up redundant articles, prepositions, conjunctions appeared
------------------------------------------
[...truncated 18.85 KB...]
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.15-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.15
Using cached botocore-1.27.15-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813521 sha256=ac153b92f1ae4888b8773c005f6482ab16cacaf8d82672b4ffbdb9a42a20af17
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.15 botocore-1.27.15 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 17.82s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 6s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pisam5csc2gow
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #230
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/230/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/datastore from 1.6.0 to 1.8.0 in /sdks (#21973)
[noreply] Bump google.golang.org/api from 0.83.0 to 0.85.0 in /sdks (#21974)
[noreply] [Go SDK] Adds a snippet for GBK in BPG (#21842)
[noreply] Update parameterized requirement in /sdks/python (#21975)
[noreply] Merge pull request #21981 from [Playground] Upgrade Flutter linter, fix
------------------------------------------
[...truncated 18.85 KB...]
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.14
Using cached botocore-1.27.14-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813542 sha256=c7a19d57c1251f82b1cacd2242d2c93758d976f3bc10afb3f895075574771ff6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.14 botocore-1.27.14 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.8.1 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 9.37s[0m[33m ========================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 28s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gxrvg2m6bi266
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #229
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/229/display/redirect>
Changes:
------------------------------------------
[...truncated 18.80 KB...]
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.3-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.14-py3-none-any.whl (132 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.14
Using cached botocore-1.27.14-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813543 sha256=036d7b5eb20e7843299c52c16492c111acb77709e83286b95075afc808a0384a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.14 botocore-1.27.14 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.3 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 9.50s[0m[33m ========================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 15s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/azwz3lp57ybni
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #228
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/228/display/redirect?page=changes>
Changes:
[yiru] fix: Add a retry code to insertall retry policy
[noreply] Add ExecuteBundles transform to Go FhirIO (#21840)
------------------------------------------
[...truncated 18.88 KB...]
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.14-py3-none-any.whl (132 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.3-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.14
Using cached botocore-1.27.14-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813543 sha256=6fad89a13b4b2fea5f535c98273cfa7aad707e56a7f7f55888f57a06930d806e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.14 botocore-1.27.14 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.3 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 10.89s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/b2zbjnhzaczky
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #227
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/227/display/redirect?page=changes>
Changes:
[bulat.safiullin] [Website] add lyft to quote cards on homepage, use relative paths for
[noreply] Update documentations and document generation (#21965)
------------------------------------------
[...truncated 19.06 KB...]
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.3-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.14
Downloading botocore-1.27.14-py3-none-any.whl (8.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.9/8.9 MB 84.7 MB/s eta 0:00:00
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.3-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813543 sha256=9dcb82bc47780b49315e3d70c63b32916b7089dc754d30ea78b5e87c105b2310
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.14 botocore-1.27.14 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.3 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.3 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 10.77s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 27s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3ous5dl5j26zg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #226
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/226/display/redirect?page=changes>
Changes:
[johnjcasey] 21742 add warning for risky kafka configuration
[johnjcasey] 21742 run spotless
[noreply] [BEAM-13590]Update Pytest version to support Python 3.10 (#17791)
[noreply] Fix target email for flaky test/p0/p1 reports
[noreply] Add unit testing for graphx/user.go (#21962)
------------------------------------------
[...truncated 18.84 KB...]
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.13-py3-none-any.whl (132 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<8.0,>=7.1.2
Using cached pytest-7.1.2-py3-none-any.whl (297 kB)
Collecting pytest-xdist<3,>=2.5.0
Using cached pytest_xdist-2.5.0-py3-none-any.whl (41 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.13
Using cached botocore-1.27.13-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=19.2.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Requirement already satisfied: py>=1.8.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.11.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.41.0.dev0) (1.0.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813444 sha256=2f7cf655a47ba2e774034ee9e7fa228a46674023fb1f3f6e81a7046272d267f0
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, tomli, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Successfully installed apache-beam-2.41.0.dev0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.13 botocore-1.27.13 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m======================= [33m[1m1 skipped[0m, [33m[1m17 warnings[0m[33m in 10.21s[0m[33m =======================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 28s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/setvipxl2h3ey
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #225
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/225/display/redirect>
Changes:
------------------------------------------
[...truncated 18.54 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.13-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.13
Using cached botocore-1.27.13-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=e55aa09b4f78af9eb15698340501cd6777bf9ecc8a84f56634ebf66efc759cab
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.13 botocore-1.27.13 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 18.92 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xssnhfne762zi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #224
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/224/display/redirect>
Changes:
------------------------------------------
[...truncated 18.52 KB...]
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.13
Using cached botocore-1.27.13-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=145be16d1bfd459d73f126ccec118a19c3d4e5368638bb5fbd2b9641b1703692
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.13 botocore-1.27.13 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 18.82 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nacvtkw3qhih4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #223
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/223/display/redirect?page=changes>
Changes:
[noreply] Modified KafkaIO.Read SDF->Legacy forced override to fail if configured
------------------------------------------
[...truncated 18.70 KB...]
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Downloading boto3-1.24.13-py3-none-any.whl (132 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.5/132.5 kB 4.8 MB/s eta 0:00:00
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.13
Downloading botocore-1.27.13-py3-none-any.whl (8.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.9/8.9 MB 80.6 MB/s eta 0:00:00
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=1d30261eb56d4f3e1c26f7df31d750feca2980dd7a974c9c08be499f9fa87a9a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.13 botocore-1.27.13 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.06 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/laacltod4u4gc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #222
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/222/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [BEAM-12918] Add PostCommit_Java_Tpcds_Flink job
------------------------------------------
[...truncated 18.50 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=90ff3889bde95d41a60cc844cea8bfebec75272bd494b640216d6a1aed48967c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.44 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nsgjtsgsh3h7k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #221
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/221/display/redirect>
Changes:
------------------------------------------
[...truncated 18.52 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=c3ff115da9c5f1ed83293cd75de592e2891abf38cc4f926c1cc7fa3f187be4e8
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.3 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.80 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qudvjtap3zkjq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #220
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/220/display/redirect>
Changes:
------------------------------------------
[...truncated 18.56 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.4.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=a0a98ad0ab4da8d701fe864fc6e5c545ebb99870aa6200248a233f01e6ceedd1
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.91 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pys3icsx5lsgs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #219
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/219/display/redirect>
Changes:
------------------------------------------
[...truncated 18.53 KB...]
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.6.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=a3a6a6be66f2fb5e63175355ac1d42d8c04116a20e3473a99cdb63cf64fa26bf
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.39 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/k4zar3bbnqrr4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #218
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/218/display/redirect>
Changes:
------------------------------------------
[...truncated 18.49 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.5.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=d68e21aab13e6018aadfb3ec9633d6691cbed2986a2fe95d99c59f6118089f00
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 18.42 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xy72ng2bie3yc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #217
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/217/display/redirect>
Changes:
------------------------------------------
[...truncated 18.49 KB...]
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.5.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=5825be7bd3028bc8fd32dddf815f39834f2397625cbdb36764b3a6cc861461f0
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.34 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i7xdoaotatbp2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #216
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/216/display/redirect>
Changes:
------------------------------------------
[...truncated 18.49 KB...]
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.5.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=6170f57d640f99e4bc59cb7310dce3b4c40a6a95eef5006b12ea05f49ecb041b
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 53.36 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vabuqjmsxe65u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #215
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/215/display/redirect?page=changes>
Changes:
[Pablo Estrada] Removing playground from main page to remove scrolling issue
[noreply] Merge pull request #21940 from [21941] Fix no output timestamp case
------------------------------------------
[...truncated 18.50 KB...]
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.5.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=be201e12e952f7a01405c6975bf0ae150871df2fb03887dfad4c139bc17c661d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 17.72 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mqrdu72o7q6t4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #214
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/214/display/redirect>
Changes:
------------------------------------------
[...truncated 18.59 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.5.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=c7eb2adcb091d1ad55a583c6b089c3fbfcf5c6a23e4330701fdf907d0ee238f6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 18.55 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xa7yqpxs434m2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #213
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/213/display/redirect>
Changes:
------------------------------------------
[...truncated 18.59 KB...]
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Using cached boto3-1.24.12-py3-none-any.whl (132 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.5.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=9c72b7f381bdc65985bb48939de9a5260203b4fec90d70f9bd668ec7b308ddc0
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 18.42 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vuzipeeafiqak
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #212
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/212/display/redirect?page=changes>
Changes:
[noreply] Update names.py
[noreply] BigQueryIO: Adding the BASIC view setting to getTable request (#21879)
------------------------------------------
[...truncated 18.55 KB...]
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.5,>=1.0
Using cached pandas-1.4.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.2.1-py3-none-any.whl (16 kB)
Collecting joblib>=1.0.1
Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting botocore<1.28.0,>=1.27.12
Using cached botocore-1.27.12-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.5.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813443 sha256=8fde3f2f73157a91c8755b7761f2834a8b7e6aee428a3fc40ef54ca6ef914441
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.32 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 38s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/f7qp3hvmeyyum
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #211
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/211/display/redirect?page=changes>
Changes:
[yathu] Unsickbay copy_rewrite_token tests
[yathu] Fix beam_PostCommit_Java_Sickbay build
[bulat.safiullin] [Website] add publishdate attribute to frontmatter
[noreply] Add guidance on self-assigning/closing to issue templates (#21931)
[noreply] [Website] add new case-study, fix styles, add related images (#21891)
[noreply] Merge pull request #21928 from [Fixes #21927] Compress
------------------------------------------
[...truncated 19.01 KB...]
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31.2 MB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.37-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.6.0-py2.py3-none-any.whl (41 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.8.0-py2.py3-none-any.whl (164 kB)
Collecting google-auth-httplib2<0.2.0,>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.13.0-py2.py3-none-any.whl (234 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.4.2-py2.py3-none-any.whl (265 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.34.4-py2.py3-none-any.whl (206 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.13.2-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.2-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.3-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=3.0.0
Using cached google_cloud_dlp-3.7.1-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.2-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.12.0-py3-none-any.whl (366 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.24.1-py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Downloading boto3-1.24.12-py3-none-any.whl (132 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.5/132.5 kB 4.7 MB/s eta 0:00:00
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from azure-core>=1.7.0->apache-beam==2.41.0.dev0) (1.16.0)
Collecting msrest>=0.6.21
Using cached msrest-0.7.1-py3-none-any.whl (85 kB)
Collecting botocore<1.28.0,>=1.27.12
Downloading botocore-1.27.12-py3-none-any.whl (8.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.9/8.9 MB 79.7 MB/s eta 0:00:00
Collecting s3transfer<0.7.0,>=0.6.0
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting jmespath<2.0.0,>=0.7.1
Downloading jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.5.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813440 sha256=0f7ca8ac25ff3c451b09c0a3b4617a7accca5e719d8d20043b4604aa75efa223
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.12 botocore-1.27.12 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] / gw4 [0] / gw5 [0] / gw6 [0] / gw7 [0]
scheduling tests via LoadFileScheduling
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[33m[1m==================== 1 skipped, 8 warnings in 19.87 seconds ====================[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 5
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5sglledgtjgzc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #210
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/210/display/redirect?page=changes>
Changes:
[ahmedabualsaud] test fixes
[ahmedabualsaud] no need for this line
[Kenneth Knowles] Suppress unneeded spotbugs unused store warnings
[Kenneth Knowles] Eliminate nullness errors in KafkaIO
[noreply] Expand pr bot to python (#21791)
[noreply] Update run inference documentation (#21921)
[noreply] Consider skipped checks successful (#21924)
------------------------------------------
[...truncated 22.72 KB...]
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813425 sha256=b83cffc2a415dd0e6716e2946ee011bdacf32cd78f7a60830a5cf322d8beb222
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.11 botocore-1.27.11 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.09497714042663574 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03529763221740723 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 25.28 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vth3j4au2ywqm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #209
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/209/display/redirect?page=changes>
Changes:
[yathu] [BEAM-3177][BEAM-5468] Add pipeline options to set default logging level
------------------------------------------
[...truncated 22.74 KB...]
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2813356 sha256=2318b13eef6af8ac6803f2383fff95ea0e797ede6926a948e625f3e08b7f34b8
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.11 botocore-1.27.11 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06092429161071777 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.047239065170288086 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 29.32 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 53s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/esg5trtqpcpg2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #208
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/208/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Re-activate nullness checking for some of sdks/java/core/coders
------------------------------------------
[...truncated 22.66 KB...]
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2812959 sha256=613340dc69d57c416d9b6bb7264b026fa5b2a1e540af6a5c44a675708f2825da
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.11 botocore-1.27.11 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.045150041580200195 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03743863105773926 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 23.09 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ctblvkdkuzcxk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #207
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/207/display/redirect?page=changes>
Changes:
[noreply] Remove dataframe warnings from py38-docs logs (#21861)
[noreply] Update references to Jira to GH for the Java SDK (#21836)
[noreply] [21709] - Fix for "beam_PostCommit_Java_ValidatesRunner_Samza Failing"
[noreply] Update references to jira to GH for the Runners (#21835)
[noreply] Update remaining references to Jira to GH (#21834)
------------------------------------------
[...truncated 22.68 KB...]
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2812959 sha256=36cd79bdce08960e61d1fc9818af0b363533d2469972628e6f361306659ab436
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.11 botocore-1.27.11 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05242729187011719 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03432297706604004 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 19.73 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 32s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i2esc3qgiasy2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #206
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/206/display/redirect?page=changes>
Changes:
[egalpin] Drops usage of setWindowingStrategyInternal in favour of direct use of
[egalpin] Gives unique names to ES IO Write windowing
[Pablo Estrada] Update Python base image requirements
[Kenneth Knowles] Revert "convert windmill min timestamp to beam min timestamp"
[noreply] Fix a few small config issues (#21909)
[dannymccormick] Update py to python label
[noreply] Daily p0/p1/flaky reports for issues (#21725)
------------------------------------------
[...truncated 22.73 KB...]
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2812959 sha256=b7f8b6a7f229de2faaac0653a4ed288521a205fd019b7b8ea738e2ba80ca47af
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.10 botocore-1.27.10 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06691145896911621 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0412142276763916 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 26.43 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 46s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yrey3b6rne36i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #205
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/205/display/redirect>
Changes:
------------------------------------------
[...truncated 22.69 KB...]
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2812959 sha256=2e8cca5627597be651b0cdb8477bed477173b7f8e4baffd595d5a67771fba255
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.10 botocore-1.27.10 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05031752586364746 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04162096977233887 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.32 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lr3co23nig5em
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #204
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/204/display/redirect?page=changes>
Changes:
[Valentyn Tymofieiev] Rollback dill.
[noreply] Updated documentation for ml.inference docs. (#21868)
[Pablo Estrada] Moving to 2.41.0-SNAPSHOT on master branch.
[noreply] Add a type hint to nexmark query 3 joinFn (#21873)
------------------------------------------
[...truncated 22.71 KB...]
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.41.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.41.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.41.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.41.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.41.0.dev0-py3-none-any.whl size=2812959 sha256=af8e3fba316375cc761828683b739496f6cddb3ef53dfb772eece3ff2174b606
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.41.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.10 botocore-1.27.10 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.046076059341430664 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04084134101867676 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 28.61 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 53s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zt4pmr7n7t766
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #203
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/203/display/redirect?page=changes>
Changes:
[nielm] Add Spanner Integration tests to verify exception handling
[noreply] Switch go todos from issue # syntax to links (#21890)
[noreply] Add Pytorch image segmentation example (#21766)
[noreply] Add README documentation for scikit-learn MNIST example (#21887)
[noreply] Decompose labels for new issues (#21888)
[noreply] Use Go 1.18 for go-licenses (#21896)
[noreply] [BEAM-12903] Cron job to cleanup Dataproc leaked resources (#21779)
[noreply] [BEAM-7209][BEAM-9351][BEAM-9428] Upgrade Hive to version 3.1.3 (#17749)
[noreply] Sharding IO tests (Kafka, Debezium, JDBC, Kinesis, Neo4j) from the
[noreply] Merge pull request #17604 from [BEAM-14315] Match updated files
[noreply] Merge pull request #21781 from Sklearn Mnist example and IT test
[noreply] Get the latest version of go-licenses (#21901)
[noreply] Hide internal helpers added to DoFn for batched DoFns (#21860)
------------------------------------------
[...truncated 22.73 KB...]
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2812262 sha256=ebcf9dce4e237c5e266a0ea09e214fbcb0ead46349f5a03a5a416209abe4cf9a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.10 botocore-1.27.10 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04871249198913574 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03794240951538086 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 20.26 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 38s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zm2vk3ljogt7c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #202
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/202/display/redirect?page=changes>
Changes:
[naireenhussain] convert windmill min timestamp to beam min timestamp
[dannymccormick] Mark issues as triaged when they are assigned
[noreply] Sickbay Pytorch example IT test (#21857)
[noreply] Add required=True to Pytorch image classification example (#21883)
------------------------------------------
[...truncated 22.73 KB...]
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2802082 sha256=6cd0907739628c331961bdafe84de201d15b13431602c351fb8972712bddb991
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.9 botocore-1.27.9 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05253958702087402 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04555797576904297 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 34.49 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 29s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ykmme6cv6hvwy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #201
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/201/display/redirect?page=changes>
Changes:
[bulat.safiullin] [BEAM-13229] side nav bug fixed
[bulat.safiullin] fix links for pipelines
[noreply] Adding more info to the sdk_worker_parallelism description (#21839)
[noreply] Add Bert Language Modeling example (#21818)
[noreply] [BEAM-14524] Returning NamedTuple from RunInference transform (#17773)
[noreply] Unit tests for RunInference keyed/unkeyed Modelhandler and examples
[noreply] Remove kwargs and add explicit runinference_args (#21806)
[noreply] Modify README for 3 pytorch examples (#21871)
------------------------------------------
[...truncated 22.60 KB...]
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2802132 sha256=57e93b791d84c3ca0d513acf74e55099641b6f6cdebe77faa5d49f733b8a5832
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.9 botocore-1.27.9 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0906212329864502 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0536799430847168 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 75.35 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 57s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xjy2rbtudgi7k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #200
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/200/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #21793: [21794 ] Fix output timestamp in Dataflow.
------------------------------------------
[...truncated 22.60 KB...]
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2797588 sha256=514492fa24996bc88d6bc0fa98c646d796ccb6c64186d6497c1ece44d61a71c2
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.9 botocore-1.27.9 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06857776641845703 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04873466491699219 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.92 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ba6wtetjlykqg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #199
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/199/display/redirect?page=changes>
Changes:
[nielm] Add transform names to help debug flaky test
[chamikaramj] Automatically enable Runner v2 for pipelines that use cross-language
[Kenneth Knowles] Adjust Jenkins configuration to allow more memory per JVM
[noreply] [BEAM-14553] Add destination coder to FileResultCoder components
[noreply] copyedited README for RunInference examples (#21855)
[noreply] Document and test overriding batch type inference (#21844)
[noreply] Update references to Jira to GH for the Python SDK (#21831)
[noreply] add highlights to changes (#21865)
------------------------------------------
[...truncated 22.59 KB...]
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2797588 sha256=b5878f012d71a44ad5ac3b7ca71e8ab47d650a740b36f4662da138f540ad3528
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.9 botocore-1.27.9 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.6.0 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:200: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.07575559616088867 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit https://github.com/apache/beam/issues/20934[0m
[1m # maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:145: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04357194900512695 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 28.99 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 8s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tgxrifdy4do5o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #198
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/198/display/redirect?page=changes>
Changes:
[Jan Lukavský] [BEAM-14265] Add watermark hold for all timers
[noreply] Bump Python beam-master container (#21820)
[noreply] Split PytorchModelHandler into PytorchModelHandlerTensor and
[noreply] Fix Hadoop Downloader Range not correct (#21778)
[noreply] [BEAM-14036] Read Configuration for Pub/Sub SchemaTransform (#17730)
[noreply] [Go SDK] Add more info to Worker Status API (#21776)
[noreply] Make PeriodicImpulse generates unbounded PCollection (#21815)
[noreply] [BEAM-14267] Update watchForNewFiles to allow watching updated files
[noreply] fix timestamp conversion in Google Cloud Datastore Connector (#17789)
[noreply] Update references to Jira to GH for the Go label (#21830)
[noreply] [#21853] Adjust Go cross-compile to target entire package (#21854)
------------------------------------------
[...truncated 22.45 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794804 sha256=12626a3afaa19c4107f4e8f930e88cbec09faa504f13b782dcd03bc20c884e7e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.8 botocore-1.27.8 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.6 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.050812482833862305 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.040875911712646484 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 26.36 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 34s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ldg6llcntlvwg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #197
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/197/display/redirect>
Changes:
------------------------------------------
[...truncated 22.51 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794245 sha256=0de48c673ce048ff6604f673eb2cbd64b8d092d5d4e81914c7470da66c35c357
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.8 botocore-1.27.8 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04537391662597656 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03748512268066406 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 22.22 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2p3a5lscxrjy6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #196
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/196/display/redirect?page=changes>
Changes:
[noreply] Composite triggers and unit tests for Go SDK (#21756)
[Kiley Sok] Enable phrase trigger for a few post commits
[Kiley Sok] spotless
[noreply] [BEAM-14557] Read and Seek Runner Capabilities in Go SDK (#17821)
[noreply] [BEAM-13806] Add x-lang BigQuery IO integration test to Go SDK. (#16818)
------------------------------------------
[...truncated 22.54 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794245 sha256=5521e03a5162e3b207c5ebd332e636388aaa96461dfc0f28d782f7947e3bbc50
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.8 botocore-1.27.8 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06558442115783691 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0426785945892334 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.85 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qs5gyiau6b3r4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #195
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/195/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/pubsub from 1.21.1 to 1.22.2 in /sdks
[dannymccormick] Stop collecting jira metrics
[dannymccormick] Move to contains notation
[dannymccormick] fix query to get all updated issues
[noreply] Provide a diagnostic error message when a filesystem scheme is not
[Kiley Sok] Disable more triggers
[noreply] [BEAM-14532] Add integration testing to fhirio Read transform (#17803)
[noreply] Merge pull request #17794 from [#21252] Enforce pubsub message
[noreply] Separated pandas and numpy implementations of sklearn. (#21803)
------------------------------------------
[...truncated 22.53 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794245 sha256=c63b445de7471c9d54f9dd65e9e3a230b9ef56f72e54c1c0a05c5cdc2fac6aeb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.8 botocore-1.27.8 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.1 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.053495168685913086 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0453639030456543 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.71 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 33s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dtdeneqe5zyvg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #194
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/194/display/redirect?page=changes>
Changes:
[noreply] Refactor code according to keyedModelHandler changes (#21819)
[noreply] Add RunInference API to CHANGES.md (#21754)
[Kenneth Knowles] Do not allow postcommit jobs phrase triggering
[noreply] Refactor API code to base.py in RunInference (#21801)
------------------------------------------
[...truncated 22.50 KB...]
Using cached botocore-1.27.7-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.4.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2793956 sha256=0d0ec4785721fc84bab4599ff08cff56d5487f17890fa5651d89ffdd37eb4f8c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05722665786743164 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.039986610412597656 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 20.39 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jzbizp3mmztzo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #193
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/193/display/redirect>
Changes:
------------------------------------------
[...truncated 22.49 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.4)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=f9c7d1a43b3dfbbc6b876966de8bbd94595a7d7726073c350d79768a73460261
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04943585395812988 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04941248893737793 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.72 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 40s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dj2p3bwfivfne
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #192
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/192/display/redirect>
Changes:
------------------------------------------
[...truncated 22.51 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.4)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=b3697ba4907d32265e954b71bcf9393031be2a74b4b6db431e7fb3d3eb370ae6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05307292938232422 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04414200782775879 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 22.54 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 40s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/s2g4w2f4nnte6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #191
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/191/display/redirect>
Changes:
------------------------------------------
[...truncated 22.51 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.4)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=c699dbf1f2d2dd27a6b626a49875f35f655494f3912bc0ebe2855a004be36a2b
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05951857566833496 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03727102279663086 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.10 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 40s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zzvvkwpvoxwiu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #190
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/190/display/redirect>
Changes:
------------------------------------------
[...truncated 22.51 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.4)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=852863851b64538b354a113cba5c3f6f76a5cf99d875b805891b7c8d9766d699
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0715334415435791 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04673337936401367 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 20.75 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2fehfmbmswfby
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #189
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/189/display/redirect>
Changes:
------------------------------------------
[...truncated 22.49 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.4)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=74fca3d9d8a537fe1b1f6f6990f6a00b9e82e83c79fd52fcbde40ef9d18cbfb3
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06851458549499512 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.05396437644958496 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.56 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/frstdsef73vey
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #188
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/188/display/redirect>
Changes:
------------------------------------------
[...truncated 22.52 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.4)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=282156a4aa08bef6387859c4b365072703259706325990885cfa6ad653681327
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05076766014099121 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04808759689331055 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.81 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 38s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/u3cee4eoevhs4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #187
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/187/display/redirect>
Changes:
------------------------------------------
[...truncated 22.51 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.4)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=47d7a9432f3eed56a0330a2c9977fcfad955b056e5d7645760b05e40923925d0
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04591846466064453 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.038808584213256836 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 22.72 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 40s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/h3npymq4jdiiy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #186
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/186/display/redirect>
Changes:
------------------------------------------
[...truncated 22.51 KB...]
Using cached botocore-1.27.7-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.4)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=78a6894f5f68b2a5c10b3253df1bb4f489b37714299ab58641d7e3a2353c98c5
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04878377914428711 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.05099916458129883 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.62 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 38s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/w7hvquthmasms
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #185
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/185/display/redirect>
Changes:
------------------------------------------
[...truncated 22.49 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=97c4ce74d3f1dd543d856fdae391f678936ea8c9331760476cc4055ba4cf772a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04659628868103027 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04830288887023926 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 24.55 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 52s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/n5ool62hbb7am
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #184
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/184/display/redirect>
Changes:
------------------------------------------
[...truncated 22.51 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=843aa1543cd5dcf3ab34ca62722846c7e1e08bf53c022de956496a30f100473b
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04451441764831543 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.042749643325805664 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 22.82 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dggetfcujga7m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #183
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/183/display/redirect?page=changes>
Changes:
[noreply] Merge ModelLoader and InferenceRunner into same class. (#21795)
[noreply] Merge pull request #17589 from [BEAM-14422] Exception testing for
[noreply] Add README for image classification example (#21758)
[anandinguva98] fixup: bug
[noreply] Fix every PR linking to PR 123 (#21802)
[noreply] Add native PubSub IO prototype to Go (#17955)
[noreply] Allow creation of dynamically defined transforms in the Python expansion
[noreply] Make keying of examples explicit. (#21777)
------------------------------------------
[...truncated 22.52 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2794824 sha256=64623f0551b575a92086b73bf1bdad5c841a620de6cef1a7ea988de25365b080
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.7 botocore-1.27.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.050794124603271484 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03735780715942383 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 26.38 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 9s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/its5l573rpk6w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #182
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/182/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13769]Add no_xdist marker for cloudpickle test (#17538)
[noreply] [BEAM-14533] Bump cloudpickle to 2.1.0 (#17780)
[noreply] Add basic byte size estimation for batches (#17771)
[noreply] Add @yields_batches and @yields_elements (#19268)
[noreply] [BEAM-14535] Added support for pandas in sklearn inference runner
------------------------------------------
[...truncated 22.54 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2793100 sha256=9c3bf5615e0874faa9671998a3017a609465550f38a0189cab4065da1c973cb5
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.6 botocore-1.27.6 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04567313194274902 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04937458038330078 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 27.05 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 52s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qot5oqtxxsqbc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #181
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/181/display/redirect>
Changes:
------------------------------------------
[...truncated 22.54 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788923 sha256=97086783b49b91631c5d60d2d2409028779df834f94eac070d11e9034ad0b0f8
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.6 botocore-1.27.6 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04353451728820801 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.040311336517333984 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 20.61 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/p7jo2hrej67ry
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #180
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/180/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11104] Add code snippet for Go SDK Self-Checkpointing (#17956)
------------------------------------------
[...truncated 22.54 KB...]
Using cached botocore-1.27.6-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788923 sha256=17a5de0018ab9db9b9797d154e4391d5f0949c964d195b64ec61aa348c6d3e24
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.6 botocore-1.27.6 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.050429344177246094 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.043326616287231445 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 22.69 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mcal6knbnytgc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #179
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/179/display/redirect?page=changes>
Changes:
[dannymccormick] Update dashboards to use gh data instead of jira data
[noreply] Update .test-infra/metrics/grafana/dashboards/source_data_freshness.json
[noreply] Better cross langauge support for dataframe reads. (#21762)
[noreply] Add template_location flag to Go Dataflow runner (#21774)
[noreply] [BEAM-14406] Drain test for SDF truncation in Go SDK (#17814)
[noreply] More Jira -> Issues doc updates (#21770)
------------------------------------------
[...truncated 22.52 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788923 sha256=2e8e7685609778a26230e662ff8857a5689dbf662f789b3eca18d89d4b2a8072
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.6 botocore-1.27.6 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05919170379638672 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.05679154396057129 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 46.71 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 3s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gqr4o7sj4qi5c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #178
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/178/display/redirect?page=changes>
Changes:
[nishantjain] [BEAM-14000] Elastic search IO doesnot work when both username/password
[nishantjain] Fixes issue with httpclientbuilder - Use the existing builder instead of
[nishantjain] moves sslcontext towards starting of function
[nishantjain] adds unit test
[nishantjain] changes unit test to directly built restclient
[nishantjain] changes name of unit test
[nishantjain] adds test to all elasticsearch folder
[nishantjain] updates changes.md
[nishantjain] spotless fix
[noreply] Merge pull request #21746: Exclude GCP Java packages from Dependabot
------------------------------------------
[...truncated 22.51 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788650 sha256=6195a24ecb9ae77c4068a673f2a25402bb82f6204274f655b44e2413a003d648
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.5 botocore-1.27.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-1.7.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.7.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.28.0 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04955625534057617 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.040091514587402344 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.43 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qwsyfbs2jjkeu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #177
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/177/display/redirect>
Changes:
------------------------------------------
[...truncated 22.51 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788650 sha256=d31f3803863df3d3d710036897d3f1e1c494e492f159999d2a5ff6e39e6a669c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.5 botocore-1.27.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.1 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05037713050842285 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.040810346603393555 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.83 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mch7xjotzsi6s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #176
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/176/display/redirect?page=changes>
Changes:
[noreply] Update all links to in progress jiras to issues (#21749)
------------------------------------------
[...truncated 22.50 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788650 sha256=eaa96bd8e662102d16c7b4d79dc48db32835de9ed6e80284af81e535270662f1
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.5 botocore-1.27.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.1 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05596733093261719 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04209709167480469 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.00 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vnpdhd54prpmg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #175
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/175/display/redirect?page=changes>
Changes:
[dannymccormick] Gather metrics on GH Issues
[dannymccormick] Fixes
[dannymccormick] Fixes
[dannymccormick] Comment + naming fix
[dannymccormick] Conflicts fix
[dannymccormick] Ordering
[dannymccormick] Different fallback for prs/issues
[dannymccormick] Fix sync time
[noreply] Dont try to generate jiras as part of dependency report (#21753)
[noreply] Allow users to comment `.take-issue` without taking (#21755)
[noreply] Merge pull request: [Beam-14528]: Add ISO time format support for
------------------------------------------
[...truncated 22.86 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788628 sha256=d9fb912d75ae9d322bc0265633cf5d592f7f8bf56705309eaa77bd0bfaaafc87
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.5 botocore-1.27.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.1 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.1 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04874420166015625 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03972506523132324 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.82 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 46s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/snk74qjqesirq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #174
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/174/display/redirect?page=changes>
Changes:
[noreply] Add ability to self-assign issues for non-committers (#21719)
------------------------------------------
[...truncated 22.46 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788628 sha256=e8ba9638791d5f262a0516b2fafb9164778a455b80ed2cfc345e827fcdef98b5
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.4 botocore-1.27.4 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.0 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.1 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.045856475830078125 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.035761117935180664 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 20.92 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 27s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7cibzztzkuiu4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #173
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/173/display/redirect?page=changes>
Changes:
[noreply] Bump google.golang.org/api from 0.81.0 to 0.83.0 in /sdks (#21743)
------------------------------------------
[...truncated 22.54 KB...]
Using cached botocore-1.27.4-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788628 sha256=5d1391ca3d43e40aead597513faeffa74e56c787015329210c286517de4d4105
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.4 botocore-1.27.4 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.0 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.1 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw2] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw2] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw2] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.084320068359375 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw2] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0436253547668457 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 28.96 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 2s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qgu4m3apzshc4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #172
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/172/display/redirect?page=changes>
Changes:
[vachan] Fix for increased FAILED_PRECONDITION errors in BQ Read API.
[vachan] Adding comments.
------------------------------------------
[...truncated 22.54 KB...]
Using cached jmespath-1.0.0-py3-none-any.whl (23 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788628 sha256=97ea9e308f2f6de700169136732a9eed7c90ff05a6c13917c9c83b2eaaa90cfb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.4 botocore-1.27.4 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.0 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.1 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04990100860595703 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.046758174896240234 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 22.45 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/l6wy6z722ghey
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #171
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/171/display/redirect?page=changes>
Changes:
[nielm] Fix SpannerIO service call metrics and improve tests.
[andyye333] Add Pytorch support for batched keyed examples
[andyye333] Add general support for non-batchable kwargs params; Add
[noreply] DataflowRunner: Experiment added to disable unbounded PCcollection
[noreply] More flexible Python Callable type. (#17767)
[noreply] Fix typos in README (#17675)
------------------------------------------
[...truncated 22.50 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.3)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2788628 sha256=94eea43d5c54b9a96bb77dcffffac841e956c3f4fc111a80ec2cd109f22e2704
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.4 botocore-1.27.4 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.0 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.1 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.7.0 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.07414865493774414 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.05065035820007324 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 34.99 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 56s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7wphxfhxsxryg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #170
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/170/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [BEAM-12918] Add PostCommit_Java_Tpcds_Dataflow job
[noreply] [BEAM-12554] Create new instances of FileSink in sink_fn (#17708)
------------------------------------------
[...truncated 22.52 KB...]
Using cached botocore-1.27.3-py3-none-any.whl (8.9 MB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2785273 sha256=b6f8b02b78eada273d20c707b19ce8a356afcb8fb4ff298cf94eb509ab103d49
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.3 botocore-1.27.3 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.1 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.2 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04726576805114746 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04183244705200195 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.99 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 44s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wbobkm2lrtsxy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #169
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/169/display/redirect>
Changes:
------------------------------------------
[...truncated 22.67 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2784944 sha256=9e6398813f43958cf15b5786e4dcf6e84fbc80b724b8dd80204deab62fd6cf49
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.3 botocore-1.27.3 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05319356918334961 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04806160926818848 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.90 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5ymmjrrrql6oa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #168
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/168/display/redirect>
Changes:
------------------------------------------
[...truncated 22.68 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2784944 sha256=9fa542ca4076860fc8c0ea94a2ebddf9222b7efd5ccaabca0dc540656593106a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.3 botocore-1.27.3 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.13.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.060025691986083984 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.048532724380493164 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.37 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 40s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ybiibpt46z7du
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #167
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/167/display/redirect?page=changes>
Changes:
[yathu] [BEAM-14471] Fix PytestUnknownMarkingWarning
[Robert Bradshaw] Populate missing display data for remotely expanded transforms.
[noreply] Mount GCP credentials in local docker environments. (#19265)
[noreply] [BEAM-14068]Add Pytorch inference IT test and example (#17462)
[noreply] [Playground] [Hotfix] Remove autoscrolling from embedded editor (#21717)
------------------------------------------
[...truncated 22.52 KB...]
Using cached s3transfer-0.6.0-py3-none-any.whl (79 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (446 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.17.3-py3-none-any.whl (18 kB)
Collecting oauth2client>=1.4.12
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.1-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.6-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2784944 sha256=911d2f0593a8f8afceed1bc388b313c65b63b7fa8c99a14a5e5766bc93d83b53
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.3 botocore-1.27.3 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.051728010177612305 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04138040542602539 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m=============== 2 failed, 1 skipped, 8 warnings in 21.73 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 40s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/y4c24e2mm3dru
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #166
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/166/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Add an option to run Python operations in-line when invoked as a remote
[Robert Bradshaw] Pass options underlying runner in remote job service.
[noreply] Update Jira -> Issues in the Readme
[noreply] [Fixes #18679] Ensure that usage of metrics on a template job reports an
[noreply] Clean up uses of == instead of === in ts sdk (#17732)
[Robert Bradshaw] Comment, lint fixes.
------------------------------------------
[...truncated 25.19 KB...]
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779892 sha256=0e845c63c1efbeb39e890e788fc7dbb7609a950d26ab09d6aa15c7d27426f67b
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05466938018798828 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04481911659240723 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 36 warnings in 22.60 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/v3in7rzx5fary
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #165
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/165/display/redirect>
Changes:
------------------------------------------
[...truncated 25.30 KB...]
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=05ad55f625ff5ca46b5c9843748002bf810295a1daff6960cda4f3b2700776bb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05267214775085449 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.036644697189331055 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 22.20 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sfom7glm6dzxa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #164
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/164/display/redirect>
Changes:
------------------------------------------
[...truncated 25.31 KB...]
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=7d1ee5ce9dcb49dee069e420de0059e5a314475d1287aaea62aad792fb296657
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.08092737197875977 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.055029869079589844 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 22.08 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bdfbbknn53sje
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #163
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/163/display/redirect>
Changes:
------------------------------------------
[...truncated 25.39 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=e4b902863542766511ca1fe4b6e7fd7ce69e816241d450a875a36ebd08bf0d3e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.047336578369140625 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.046549081802368164 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 22.27 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uvznvk4o5kxxu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #162
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/162/display/redirect>
Changes:
------------------------------------------
[...truncated 25.39 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=e8229959aa13d03cef38d7f517faa2aa24ae3c8b754cc70b12dfec1a120069d5
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.057337284088134766 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03687787055969238 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 22.42 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ybrziq633johc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #161
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/161/display/redirect>
Changes:
------------------------------------------
[...truncated 25.22 KB...]
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=e364f3cd89213682aeeae7fcf012e48c0659bef45b6214063d2c2d25da1c7f6c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04927849769592285 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0419161319732666 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 36 warnings in 22.75 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yavydtpicrfr2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #160
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/160/display/redirect>
Changes:
------------------------------------------
[...truncated 25.23 KB...]
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=3b67b7fb6aab8fa842033a2bd3afedbdfc05e12732259c1cd5b0bf9875b6a33d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.056905269622802734 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.041596174240112305 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 36 warnings in 21.38 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/f65oou4tpeejg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #159
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/159/display/redirect>
Changes:
------------------------------------------
[...truncated 25.55 KB...]
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=dc663f5230a9ac8b9fcf459b1ffee67fecb4342618244ac315d0007865ae05e1
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.049367427825927734 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.05235862731933594 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 44 warnings in 20.89 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xjgqnaz75btpg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #158
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/158/display/redirect>
Changes:
------------------------------------------
[...truncated 25.31 KB...]
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=b8f3564a562ddb264dde3662cc751f63fdb9929fea71f9a3048d2f4d9d79f859
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.046758413314819336 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04683947563171387 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 21.46 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6ql7a57w5p6k2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #157
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/157/display/redirect>
Changes:
------------------------------------------
[...truncated 25.39 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=dec5b044f5c9858f27dd8ddf87710ac6560b9a165d428f939b64d08a01e307ad
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.07994771003723145 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0397951602935791 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 22.21 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bczb35jhma4gc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #156
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/156/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14556] Honor the formatter installed on the root handler. (#17820)
------------------------------------------
[...truncated 25.39 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=d580d62f213e3fe00d27aaafd338d2b7cf03bfe337a08fb30c82bb6190184ceb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05916404724121094 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03949308395385742 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 18.83 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 34s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zt6jgzvypebck
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #155
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/155/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #17741 from [BEAM-14504] Add support for including
[noreply] Merge pull request #18374 from [BEAM-13945] Roll forward JSON support
[noreply] Merge pull request #17792 from [BEAM-13756] [Playground] Merge Log and
[noreply] Merge pull request #17779: [BEAM-14529] Add integer to float64
------------------------------------------
[...truncated 25.12 KB...]
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=cac929f466ecef4e95de9cee2c1eb746731a0a280ba573794c15661ef6ac62e4
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.1 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw3] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw3] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0475766658782959 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03911280632019043 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 34 warnings in 33.86 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 11s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3fwevmg2j3irc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #154
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/154/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14441] Enable GitHub issues (#17812)
[Pablo Estrada] Revert "Merge pull request #17492 from [BEAM-13945] (FIX) Update Java BQ
[noreply] Alias worker_harness_container_image to sdk_container_image (#17817)
[noreply] [BEAM-14546] Fix errant pass for empty collections in Count (#17813)
------------------------------------------
[...truncated 25.13 KB...]
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=7fdd3b45a2d16eb349b13bf3b415d5a559bc5c8c53c86bd56d2f5140e44e979e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.0 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05223894119262695 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04897332191467285 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 21.79 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/k7ab2kbtt4y7g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #153
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/153/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11167] Updates dill package to version 0.3.5.1 (#17669)
[noreply] [BEAM-6258] Use gRPC 1.33.1 as min version to ensure that we pickup
------------------------------------------
[...truncated 25.41 KB...]
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779621 sha256=3f89158122d204da497a72af75f0f0efe55a4cc949b2bf1a42fe2d904c310048
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.5.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.0 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.044042348861694336 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03850126266479492 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 20.82 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 33s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pbfhjxvkripla
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #152
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/152/display/redirect>
Changes:
------------------------------------------
[...truncated 25.23 KB...]
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779623 sha256=b0d1bf35432e269ca91671bf02530132deb5a14b2e7638e931d5e20fa9dfcdc6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.7.0 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.09561753273010254 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04879355430603027 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 20.00 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 21s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nsme5m5dhv5oe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #151
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/151/display/redirect?page=changes>
Changes:
[dannymccormick] [BEAM-14446] Update some docs to point to GitHub issues
[dannymccormick] More doc updates
[dannymccormick] Update issueManagement fields
[dannymccormick] Fix website build
[dannymccormick] Remove extraneous comment line
[noreply] Commit message guidance
[noreply] Bump google.golang.org/grpc from 1.46.2 to 1.47.0 in /sdks (#17806)
[noreply] Rename pytorch files (#17798)
[noreply] Merge pull request #17492 from [BEAM-13945] (FIX) Update Java BQ
[noreply] [BEAM-11105] Add more watermark estimation docs for go (#17785)
[noreply] [BEAM-11106] documentation for SDF truncation in Go (#17781)
------------------------------------------
[...truncated 25.46 KB...]
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779623 sha256=61426b3c77340d6fb3b77a738820f0198a8c9a05944a3dae6f3df1abfd56dc22
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.2 botocore-1.27.2 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.9 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.07015347480773926 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.06526732444763184 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 36 warnings in 24.13 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 53s
15 actionable tasks: 12 executed, 2 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/b6rbhmm4lwzxo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #150
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/150/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14539] Ensure that the print stream can handle larger byte arrays
[noreply] [BEAM-10976] Fix bug with bundle finalization on SDFs (and a small doc
------------------------------------------
[...truncated 25.12 KB...]
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779579 sha256=e25e2a9d6f13e4e5547af7383d151bb7ec6afa90f2318264de00290a2982958f
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.1 botocore-1.27.1 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.9 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05893826484680176 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.049492835998535156 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 24.23 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 56s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/k7xrcvo6us2qi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #149
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/149/display/redirect>
Changes:
------------------------------------------
[...truncated 25.35 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779579 sha256=af845c5769edab9f6b44965e8d71b94c27a0bdefbaf3f829e40e95984820b631
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.1 botocore-1.27.1 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.9 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.07794761657714844 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.045176029205322266 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 20.94 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ulucckhdfcxvq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #148
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/148/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14511] Growable Tracker for Go SDK (#17754)
------------------------------------------
[...truncated 25.26 KB...]
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779579 sha256=53cc51c696793ab1be5c214884f3e5d9f4d1a9e67f7191206c5e6189c1a953cf
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.1 botocore-1.27.1 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.9 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.056024789810180664 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.06433320045471191 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 23.91 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/24mz4zpng37wg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #147
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/147/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Fix parsing of -PenableCheckerFramework in build
[Kenneth Knowles] Fix additional nullness errors in BigQueryIO
[yathu] [BEAM-13984] followup Fix precommit
[noreply] [BEAM-14536] Handle 0.0 splits in offsetrange restriction (#17782)
[noreply] [BEAM-14470] Use lifecycle method names directly. (#17790)
[noreply] [BEAM-14297] add nullable annotations and an integration test (#17742)
[noreply] Only generate Javadocs for latest Spark runner version (Spark 3) to fix
[noreply] Fail Javadoc aggregateJavadoc task if there's an error (#17801)
[noreply] Merge pull request #17753 from [BEAM-14510] adding exception tests to
[noreply] feat: allow for unknown values in change streams (#17655)
[noreply] Support JdbcIO autosharding in Python (#16921)
------------------------------------------
[...truncated 25.21 KB...]
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779579 sha256=4821b7b24f8f11fa019612d8c5372d5aa44540cfa2c8012038058d085d67f369
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.1 azure-storage-blob-12.12.0 boto3-1.24.1 botocore-1.27.1 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.9 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05638861656188965 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.2540442943572998 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 22.04 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 28s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ynqtqgtxlnrny
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #146
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/146/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14513] Add read transform and initial healthcare client (#17748)
------------------------------------------
[...truncated 25.15 KB...]
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779398 sha256=95013c3aee258a96512e9d2846007cdbb943fa83ddb7943b98847d81a4795d91
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.24.0 botocore-1.27.0 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.9 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04590129852294922 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03954887390136719 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 34 warnings in 23.97 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7bheswkh5rdfy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #145
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/145/display/redirect>
Changes:
------------------------------------------
[...truncated 25.55 KB...]
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779398 sha256=725db6131818e524c74510905c536b156a6844b0214fe17d3f24666a864ae81c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.24.0 botocore-1.27.0 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw2] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw2] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw2] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04976177215576172 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw2] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.040543556213378906 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 44 warnings in 25.60 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 44s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ekja7tkzipjg2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #144
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/144/display/redirect?page=changes>
Changes:
[noreply] Add typing information to RunInferrence. (#17762)
------------------------------------------
[...truncated 25.54 KB...]
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779398 sha256=718c618541cb29a8ce9db085f60e3131c1363a69219b4082e140ccf1270332bf
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.24.0 botocore-1.27.0 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04336977005004883 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.037396907806396484 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 44 warnings in 20.06 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/b3n4odhg2dawa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #143
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/143/display/redirect?page=changes>
Changes:
[chamikaramj] Adds Java cross-language transforms for invoking Python Map and FlatMap
[noreply] [BEAM-14449] Support cluster provisioning when using Flink on Dataproc
[noreply] [BEAM-14527] Implement "Beam Summit 2022" banner (#17776)
[noreply] Merge pull request #17222 from [BEAM-12164] Feat: Add new restriction
[noreply] Merge pull request #17598 from [BEAM-14451] Support export to BigQuery
------------------------------------------
[...truncated 25.49 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2779217 sha256=13324f1d0ad4b249713012530ea4f2cb67b32e4dd5b59f82cf4377b5bc5302ff
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.24.0 botocore-1.27.0 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.6.0 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.37 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04203224182128906 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04715085029602051 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 75.74 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 11s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/de5thubnqklw4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #142
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/142/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14255] Drop clock abstraction (#17671)
[noreply] Adds __repr__ to NullableCoder (#17757)
[noreply] Merge pull request #17683 from [BEAM-14475] add test cases to GcsUtil
[noreply] [BEAM-14410] Add test to demonstrate BEAM-14410 issue in non-cython
------------------------------------------
[...truncated 25.33 KB...]
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777668 sha256=6730872f8c83f0d66396588dcd01ec53ebf047d782534b9671959d7e41047293
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.041758060455322266 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03296613693237305 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 22.78 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 51s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sq5mrdl4rfah4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #141
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/141/display/redirect>
Changes:
------------------------------------------
[...truncated 25.40 KB...]
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=6533d572ca4a67f3a4743b57a4052b7c8b69d7d27e5c5f2af14f21aa12b5ccae
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.1413717269897461 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04674053192138672 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 22.74 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 48s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kxq63hxtvtbqi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #140
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/140/display/redirect>
Changes:
------------------------------------------
[...truncated 25.22 KB...]
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=2669431e8a8d3ffea7f5439256ce0ad20284d54dcaf90e20941c6ad95085df3d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0445561408996582 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.044748783111572266 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 23.41 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zfumoa6kpdmkg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #139
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/139/display/redirect>
Changes:
------------------------------------------
[...truncated 25.22 KB...]
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=3c959a5cdb815db8b6631f40819eb31c7bd08ca6ae4beb67fa6560299ae0e90c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05834507942199707 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04710888862609863 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 21.24 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 30s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nb2jauxxe5vto
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #138
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/138/display/redirect>
Changes:
------------------------------------------
[...truncated 25.31 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=40dc9dda870de15e3b5fd000b0b3b8d9a15377b944cb1cd8ab02cb4c53880156
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04590272903442383 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03926372528076172 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 20.55 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/cjbvr4hpexqnw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #137
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/137/display/redirect>
Changes:
------------------------------------------
[...truncated 25.40 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=a0bf264e15160d793ab654277be6d9455ecc77bfcff5898e13e474aa5beffc58
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06682515144348145 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04012560844421387 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 42 warnings in 18.66 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 21s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yevcyse3kbwws
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #136
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/136/display/redirect>
Changes:
------------------------------------------
[...truncated 25.32 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=335fc70f41772e87688aabedd2556968d25a413293b353fbc767a75ae6ffadc6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0480198860168457 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.042363882064819336 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 20.38 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gf65eablq5h4s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #135
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/135/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14170] - Create a test that runs sickbayed tests (#17471)
------------------------------------------
[...truncated 25.02 KB...]
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=bfac8af87add7981e1f4fbb3787e05fa4f7fbd46e1cc2fa792c07e2960a42975
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.043375492095947266 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03750872611999512 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 18.09 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 19s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/athhgomsbu7uc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #134
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/134/display/redirect>
Changes:
------------------------------------------
[...truncated 25.21 KB...]
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=76a0fa33ce275aff02e302f789bb37154799bc6c2c428b8fdf8803eec30973c6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06336784362792969 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04906606674194336 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 36 warnings in 19.92 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 32s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qrxzwu2i6lhf2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #133
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/133/display/redirect>
Changes:
------------------------------------------
[...truncated 25.29 KB...]
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=678d96a64c773b7f09509f1935e4ef7fe1a19084c5c86705632014a64ada1916
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.057840824127197266 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03510022163391113 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 18.60 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 20s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xiqcnzbaa46t2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #132
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/132/display/redirect>
Changes:
------------------------------------------
[...truncated 25.29 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=67fda6db463bad731a35e97c872d31b15bac0700efe1c3df9d177d1f94020194
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05597281455993652 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03989744186401367 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 20.48 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 26s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/s7eeh552s3yr2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #131
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/131/display/redirect>
Changes:
------------------------------------------
[...truncated 25.53 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=61fde3302c0c6a4b417067ab588185edd680da85c432d1cbe6ecf42a2493f639
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.10 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05948281288146973 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04332137107849121 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 42 warnings in 18.21 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 19s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zxvun7epne6lu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #130
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/130/display/redirect>
Changes:
------------------------------------------
[...truncated 25.29 KB...]
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=da7b023bc07674bc5b9bc90288f52e6e8899367b03912f80b151d26e9047afe8
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.9 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.047453880310058594 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04322004318237305 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 18.24 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 19s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/raytqk6uxmcwu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #129
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/129/display/redirect>
Changes:
------------------------------------------
[...truncated 25.20 KB...]
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=921558a95839f4da6af623e8cd31a62918b6397bab863d75efdb5ccd8cf8d575
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.9 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.046715497970581055 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04242300987243652 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 18.35 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 20s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6apxyo5vprkfk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #128
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/128/display/redirect?page=changes>
Changes:
[ilion.beyst] minor: don't capture stderr in kata tests
[noreply] [BEAM-14166] Push logic in RowWithGetters down into getters and use
[noreply] cleaned up TypeScript in coders.ts (#17689)
------------------------------------------
[...truncated 25.29 KB...]
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=024ee511a13c348a42f5cce4b62278a7886fbf9a302bb106890a9522707cc036
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.9 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.058501243591308594 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04004240036010742 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 20.24 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 24s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3jleuaugoxfxo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #127
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/127/display/redirect?page=changes>
Changes:
[Kiley Sok] Update beam-master version for legacy
[Heejong Lee] Fix NonType error when importing google.api_core fails
[noreply] [BEAM-13972] Update documentation for run inference (#17508)
[noreply] [BEAM-14502] Fix: Splitting scans into smaller chunks to buffer reads
[noreply] [BEAM-14218] Add resource location hints to base inference runner.
[noreply] [BEAM-14442] Ask for repro steps/redirect to user list in bug template
------------------------------------------
[...truncated 25.48 KB...]
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777899 sha256=6c76c9f23290a33bd42729fb2b33bcf938ca6a79137363c3a9a9d433b213ee81
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.9 botocore-1.26.10 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.08273744583129883 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04769086837768555 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 21.00 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 26s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zxpklrhzngevs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #126
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/126/display/redirect>
Changes:
------------------------------------------
[...truncated 25.47 KB...]
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777510 sha256=3d51067965d53267a6db708e76af4a7bde75a85dea2bc805f20466cd4ce850ea
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.9 botocore-1.26.9 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.6 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0845482349395752 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.05932354927062988 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 43.22 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 19s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4ifbagklwyd4y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #125
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/125/display/redirect>
Changes:
------------------------------------------
[...truncated 25.01 KB...]
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777510 sha256=3ea3ea0b945d8e798e2d410cadc94eeef152f71c8558767f19371834d9171499
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.9 botocore-1.26.9 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05124187469482422 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.042250633239746094 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 17.84 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 18s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bl4m4lll7yz4k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #124
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/124/display/redirect?page=changes>
Changes:
[thiagotnunes] BEAM-14419: Remove invalid mod type
[ihr] [BEAM-14006] Update Python katas to 2.38 and fix issue with one test
[Heejong Lee] [BEAM-14478] Fix missing 'projectId' attribute error
[relax] DLQ for BQ Storage Api writes
[noreply] Bump google.golang.org/api from 0.76.0 to 0.81.0 in /sdks
------------------------------------------
[...truncated 25.21 KB...]
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777510 sha256=c8fcf71df7ec1bf4e36db3683d663c53e877fdb377bd12d52228f2932f04bd59
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.9 botocore-1.26.9 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04892420768737793 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04234194755554199 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 18.47 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 20s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qwyn5pi544d2u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #123
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/123/display/redirect?page=changes>
Changes:
[noreply] Added standard logging when exception is thrown (#17717)
[noreply] [BEAM-13829] Enable worker status in Go
[noreply] [BEAM-14519] Add website page for Go dependencies (#17766)
[noreply] [BEAM-11106] Validate that DoFn returns Process continuation when
[noreply] [BEAM-14505] Add Dataflow streaming pipeline update support to the Go
------------------------------------------
[...truncated 25.34 KB...]
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.2-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777449 sha256=82c9dc1121cda0c704d674691204e72014e7cdb9601687cd94e829d4cb473fbb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.9 botocore-1.26.9 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.2 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.5 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.07979178428649902 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03751087188720703 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 18.13 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rr5ogro5npu2e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #122
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/122/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14336] Re-enable `flight_delays_it_test` with
[noreply] [BEAM-11106] small nits to truncate sdf exec unit (#17755)
------------------------------------------
[...truncated 25.16 KB...]
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777449 sha256=d10947164ba7e46405c04d262b721b39b3642fab1d940a035b58a28b99cf5eb2
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.8 botocore-1.26.8 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.08437561988830566 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04352569580078125 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 20.68 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 25s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4d3fgrk3orkvc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #121
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/121/display/redirect?page=changes>
Changes:
[Jan Lukavský] [BEAM-14492] add flinkConfDir to FlinkPipelineOptions
------------------------------------------
[...truncated 25.09 KB...]
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777434 sha256=cc825488a2185557bfbd07a43e5004c8577d6436485cde40afbfb0c4e294d944
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.8 botocore-1.26.8 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.09418177604675293 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04104733467102051 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 20.21 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 24s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jo4svsnsb5w62
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #120
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/120/display/redirect>
Changes:
------------------------------------------
[...truncated 25.24 KB...]
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777434 sha256=8c7845c6dfbfef2ecfad0c9acf9c40e228a0c6d0eee74275f58a4719af23496a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.8 botocore-1.26.8 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.052018165588378906 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03864598274230957 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 40 warnings in 21.21 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mm4ayruu2gxak
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #119
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/119/display/redirect?page=changes>
Changes:
[Robert Bradshaw] [BEAM-14426] Allow skipping of any output when writing an empty
[Robert Bradshaw] Add skip_if_empty attribute to base class to fix test.
[noreply] Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1 in /sdks
[noreply] [BEAM-9324] Fix incompatibility of direct runner with cython (#17728)
[noreply] [BEAM-14503] Add support for Flink 1.15 (#17739)
[noreply] Update Beam website to release 2.39.0 (#17690)
[noreply] [BEAM-14509] Add several flags to dataflow runner (#17752)
[Yichi Zhang] Fix 2.38.0 download page.
[noreply] [BEAM-14494] Fix publish_docker_images.sh (#17756)
------------------------------------------
[...truncated 25.69 KB...]
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777434 sha256=af5e2e11d3925a2b3eed49b792c635e9c0f5fe37f2af57928c263b16a8f72487
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.8 botocore-1.26.8 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.10161685943603516 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.045999765396118164 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 42 warnings in 33.25 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 14s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6gzgnejbkaujc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #118
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/118/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14139] Remove unused Flink 1.11 directory (#17750)
[noreply] [BEAM-14044] Allow ModelLoader to forward BatchElements args (#17527)
[noreply] [BEAM-14481] Remove unnecessary context (#17737)
------------------------------------------
[...truncated 24.88 KB...]
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777104 sha256=cce29c0bcc54b3b5571cfcd2affbc0dea7559479d72f3cfb897e01bfaeea2efb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.7 botocore-1.26.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.050112009048461914 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03756093978881836 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 34 warnings in 28.26 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 48s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6iikro5xbvqtc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #117
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/117/display/redirect>
Changes:
------------------------------------------
[...truncated 25.50 KB...]
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776893 sha256=22ea9bf0374c7c229660b8f43acd0f3a95cb33743d879316f6330d5023db23f1
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.7 botocore-1.26.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.062122344970703125 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04133272171020508 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 44 warnings in 20.36 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/li5uuogh2emju
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #116
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/116/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14129] Clean up PubsubLiteIO by removing options that no longer
[noreply] [BEAM-14496] Ensure that precombine is inheriting one of the timestamps
------------------------------------------
[...truncated 25.43 KB...]
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776893 sha256=182235c2aff6764e23ce461fa3d1ca308d371bbb07da7a7d0bff69a0c788c622
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.7 botocore-1.26.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0657343864440918 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.044303178787231445 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 42 warnings in 22.05 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/b35xfqagrt5gu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #115
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/115/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14471] Adding testcases and examples for xlang Python
[Heejong Lee] update
[Heejong Lee] add DataframeTransform wrapper
[noreply] Fix 'NoneType' object has no attribute error
[noreply] [BEAM-12308] change expected value in kakfa IT (#17740)
[noreply] [BEAM-14053] [CdapIO] Add wrapper class for CDAP plugin (#17150)
------------------------------------------
[...truncated 25.34 KB...]
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777233 sha256=df93939efa8238f4401b0613b78fdacb48522b606044cff9bd8ac5e4e81f9939
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.7 botocore-1.26.7 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.057265520095825195 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04132390022277832 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 38 warnings in 22.89 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pdctl2fvux4wy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #114
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/114/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14298] resolve dependency
[noreply] Fix -- linting issue (#17738)
------------------------------------------
[...truncated 22.81 KB...]
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777233 sha256=ba50f89bda5648d4f84d99b586194a97eef44a65ea44e8ef9b219d1a40e55dba
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.6 botocore-1.26.6 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04730510711669922 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.05881237983703613 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 10 warnings in 21.85 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 58s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/f5kgfhqofuiwk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #113
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/113/display/redirect>
Changes:
------------------------------------------
[...truncated 23.23 KB...]
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777233 sha256=35f0746e0ec99f3f842cd8bbfc98891d319dd4eaf633f06f57068868477f9301
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.6 botocore-1.26.6 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06473422050476074 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03937196731567383 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 20.25 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 25s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/y2364t7pklof2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #112
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/112/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14489] Remove non-SDF version of TextIO. (#17712)
------------------------------------------
[...truncated 23.49 KB...]
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777233 sha256=229154ecc69db621e847951c959ebfddd5973eddad9af22d8fc5602f6e86e1c8
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.6 botocore-1.26.6 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.08304619789123535 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04747891426086426 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 20 warnings in 21.86 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 26s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/cg7mdh25o2tni
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #111
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/111/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14494] Tag rc dockre container with format ${RELEASE}rc${RC_NUM}
[noreply] [BEAM-11578] Fix TypeError in dataflow_metrics has 0 distribution sum
[noreply] [BEAM-14499] Step global, unbounded side input case back to warning
[noreply] [BEAM-14484] Step back unexpected primary handling to warnings (#17724)
[noreply] [BEAM-14486] Document pubsubio & fix its behavior. (#17709)
------------------------------------------
[...truncated 22.92 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777233 sha256=0edfe023ea84a10664c12c7384529a2d105aa7409bfd003bfa690f2510fc20fc
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.6 botocore-1.26.6 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.07951521873474121 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03849077224731445 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 20.23 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 24s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/scxa3nkzlcyoe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #110
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/110/display/redirect>
Changes:
------------------------------------------
[...truncated 22.95 KB...]
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777230 sha256=59b3a735a8b169eeceb5b37880776f8b32e6c4f3c00e0264108ee325d0e414a8
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04657626152038574 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04139900207519531 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 20.06 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ug6hvepmqfrh4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #109
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/109/display/redirect?page=changes>
Changes:
[noreply] Add clarification on Filter transform's input function to pydoc.
[noreply] [BEAM-14367]Flaky timeout in
------------------------------------------
[...truncated 22.96 KB...]
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777230 sha256=bde0bb6ba855c8dcd61ba1aa3ec6b03597910c4708feb2dc01ac8f5455d57ce6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04687905311584473 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04182267189025879 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 22.11 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/htwdgutpdvufq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #108
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/108/display/redirect>
Changes:
------------------------------------------
[...truncated 23.01 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=b9e9e7e58da89798f60b160333382028bb84526842680f651d82d30bebb9858b
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05431485176086426 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03816866874694824 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 20.23 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/oasdl62xpdvmm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #107
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/107/display/redirect>
Changes:
------------------------------------------
[...truncated 23.25 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=21386657fa8f251f942563a0e507f46508d33b1c9eb92385f7475a06b9ebc48a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05668020248413086 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04224801063537598 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 18 warnings in 21.72 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 44s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/d3gtpj2jrq324
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #106
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/106/display/redirect>
Changes:
------------------------------------------
[...truncated 23.11 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=5deb0d89e1e462c52cb9d887bafd2350b31495d5aacf39c2e5511c8fe2893699
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.051413774490356445 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.042153358459472656 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 21.61 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rhxdndjy4obxu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #105
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/105/display/redirect>
Changes:
------------------------------------------
[...truncated 23.30 KB...]
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=a24e77b81f6aa7b1e4d428248418f2caaee15f6d0821bed642f84e3ddeee3be2
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.043704986572265625 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.046929359436035156 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 22.29 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3pdbwtug7p6no
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #104
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/104/display/redirect>
Changes:
------------------------------------------
[...truncated 23.68 KB...]
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=4a5454d75566e1508881ac494b8bf4b82e3880f9d25b1d3c15d7411df7d3e3ff
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05504155158996582 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04125237464904785 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 22 warnings in 21.25 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/r73boy3pflgiy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #103
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/103/display/redirect>
Changes:
------------------------------------------
[...truncated 23.42 KB...]
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=58aa20241eb5562ad10b4a6267536c747abecbb9448c5957bd2f89b4295245f1
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05918622016906738 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.044111013412475586 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 18 warnings in 20.39 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 40s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/inbj7iu4awd56
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #102
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/102/display/redirect>
Changes:
------------------------------------------
[...truncated 22.92 KB...]
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=5089bf64f9295e50a5682e159719a853127e7754feb20613af72fb2031555e2a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.052628517150878906 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03925609588623047 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 20.83 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 35s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7mutf2ff6ayae
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #101
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/101/display/redirect>
Changes:
------------------------------------------
[...truncated 23.30 KB...]
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=76eab972f770d807ae7070de7e72ab561b123898333d24b6820687c32341241e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.057804107666015625 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03520011901855469 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 21.22 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uohf6kfwri2mi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #100
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/100/display/redirect>
Changes:
------------------------------------------
[...truncated 23.10 KB...]
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=ce1ef24859f532968e8745ecdda2659cdc95e37c2b6da2a78dacaa95b64d2650
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw1] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw2] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw3] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw4] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw5] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw6] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw7] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.047594308853149414 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.037493228912353516 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 21.44 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 38s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lyavxati7btuq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #99
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/99/display/redirect?page=changes>
Changes:
[yathu] Add labels for typescript PRs
[noreply] [BEAM-13015] Only create a TimerBundleTracker if there are timers.
------------------------------------------
[...truncated 23.13 KB...]
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Downloading grpcio_status-1.46.3-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=9edc14d2a7f77dec4e2a5eabdaf231dbb43d367fd27cd1f031aa7f6fb738d164
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.5 botocore-1.26.5 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.3 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.4 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw1] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw2] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw3] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw4] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw7] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw5] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw6] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0803985595703125 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.045522451400756836 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 20.15 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 38s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qob2k64uiiywe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #98
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/98/display/redirect?page=changes>
Changes:
[noreply] Bump google.golang.org/grpc from 1.45.0 to 1.46.2 in /sdks (#17677)
------------------------------------------
[...truncated 23.12 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=3f1a1185756709717e7b51e64aaf5d06e0c11663ff4bef31033933ad10103997
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.4 botocore-1.26.4 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw0] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw3] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw2] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw4] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw5] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw6] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw7] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.07111954689025879 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.06353902816772461 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 30.37 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/d5dfzzmrokkb4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #97
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/97/display/redirect?page=changes>
Changes:
[bulat.safiullin] [BEAM-14418] added arrows to slider
[noreply] Minor: Bump Dataflow container versions (#17684)
------------------------------------------
[...truncated 28.37 KB...]
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Downloading googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 211.7/211.7 kB 32.2 MB/s eta 0:00:00
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Downloading google_api_core-2.7.3-py3-none-any.whl (114 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 114.6/114.6 kB 19.8 MB/s eta 0:00:00
Downloading google_api_core-2.7.2-py3-none-any.whl (114 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 114.6/114.6 kB 19.3 MB/s eta 0:00:00
Downloading google_api_core-2.7.1-py3-none-any.whl (114 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 114.7/114.7 kB 18.7 MB/s eta 0:00:00
Downloading google_api_core-2.7.0-py3-none-any.whl (114 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 114.7/114.7 kB 19.0 MB/s eta 0:00:00
Downloading google_api_core-2.6.1-py3-none-any.whl (114 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 114.6/114.6 kB 20.1 MB/s eta 0:00:00
Downloading google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 114.6/114.6 kB 20.5 MB/s eta 0:00:00
Downloading google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 111.8/111.8 kB 19.3 MB/s eta 0:00:00
Downloading google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 111.7/111.7 kB 19.8 MB/s eta 0:00:00
Downloading google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 109.8/109.8 kB 18.9 MB/s eta 0:00:00
Collecting google-crc32c<2.0dev,>=1.0
Downloading google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Downloading isodate-0.6.1-py2.py3-none-any.whl (41 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 7.5 MB/s eta 0:00:00
Collecting pyasn1>=0.1.7
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.1/77.1 kB 12.7 MB/s eta 0:00:00
Collecting typing-utils>=0.0.3
Downloading typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Downloading oauthlib-3.2.0-py3-none-any.whl (151 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.5/151.5 kB 25.7 MB/s eta 0:00:00
Building wheels for collected packages: google-apitools, apache-beam
Building wheel for google-apitools (setup.py): started
Building wheel for google-apitools (setup.py): finished with status 'done'
Created wheel for google-apitools: filename=google_apitools-0.5.31-py3-none-any.whl size=131038 sha256=36152ee3c9f5d79861332852ce9d742a2f8469a0fb97c1cba1fc69ea6de9e362
Stored in directory: /home/jenkins/.cache/pip/wheels/d7/54/79/85de1824f2f4175fb4960c72afb10045d86700c3941dc73685
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777172 sha256=9b06045297eb8576ecfaa6a498156ace6487e7c9af63c5e90e9a0fb52647c3b4
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built google-apitools apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.4 botocore-1.26.4 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw1] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw2] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw3] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw4] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw5] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw6] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw7] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04611921310424805 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04152083396911621 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 19.86 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/j6cg2hpkeusuc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #96
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/96/display/redirect?page=changes>
Changes:
[noreply] Remove unused validation configurations. (#17705)
------------------------------------------
[...truncated 23.30 KB...]
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777174 sha256=1304544a39596c1c523ed3628ed5dc86d62672c33bfc0d319d3a55430182eaf4
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.4 botocore-1.26.4 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw4] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw1] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw3] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw2] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw6] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw5] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw7] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04639267921447754 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04021286964416504 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 46.67 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yy2k4n6wcsxc2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #95
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/95/display/redirect?page=changes>
Changes:
[chamikaramj] Corrects I/O connectors availability status in Beam Website.
[noreply] Vortex performance improvement: Enable multiple stream clients per
[noreply] [BEAM-14488] Alias async flags. (#17711)
[noreply] [BEAM-14487] Make drain & update terminal states. (#17710)
[noreply] [BEAM-14484] Improve behavior surrounding primary roots in
[noreply] Improve validation error message (#17719)
------------------------------------------
[...truncated 23.26 KB...]
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18.1-py3-none-any.whl (155 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777174 sha256=74b3b0d341dcd1ba8a457a459a8b22c88dd98fd54930c73230a45d889ef81602
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.4 botocore-1.26.4 cachetools-4.2.4 certifi-2022.5.18.1 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw1] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw2] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw3] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw4] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw5] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw6] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw7] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05030250549316406 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04255557060241699 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 24.90 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 50s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/arih57iipq4dw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #94
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/94/display/redirect?page=changes>
Changes:
[singh.vikash2310] fixed typos in README.md
[noreply] Update the PTransform and associated APIs to be less class-based.
------------------------------------------
[...truncated 22.94 KB...]
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777174 sha256=dbd822a253b46f561456f6d86f0e45e4ebe8c856bcd03c7269474dbd89258464
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.3 botocore-1.26.3 cachetools-4.2.4 certifi-2022.5.18 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.7.0 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.4 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.1 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw2] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw1] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw3] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw4] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw5] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw6] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0m[1m[gw7] Python 3.8.10 (default, Nov 26 2021, 20:14:08) -- [GCC 9.3.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.048661231994628906 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.041782379150390625 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 24.98 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 57s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/avrz744iq6sfu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #93
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/93/display/redirect?page=changes>
Changes:
[bulat.safiullin] [BEAM-14428] change text, change styling of connectors and contribute
------------------------------------------
[...truncated 23.37 KB...]
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777174 sha256=81448338b98e92d3918944e3cb1a204128e8e0f5e6c64dfbfea1bb88a81c4f7b
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.3 botocore-1.26.3 cachetools-4.2.4 certifi-2022.5.18 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04247689247131348 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0708167552947998 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 18 warnings in 20.66 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 27s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wj77fksqt2goe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #92
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/92/display/redirect>
Changes:
------------------------------------------
[...truncated 22.95 KB...]
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777174 sha256=6d5f7e8b881a69410f99fc2b2349f834693401f3649b631fcc657a91b05aa8aa
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.3 botocore-1.26.3 cachetools-4.2.4 certifi-2022.5.18 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.050668954849243164 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04907798767089844 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 22.54 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nyk3kfrmnl4bk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #91
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/91/display/redirect?page=changes>
Changes:
[noreply] Update release-guide.md
------------------------------------------
[...truncated 23.21 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Downloading google_api_core-2.8.0-py3-none-any.whl (114 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 114.7/114.7 kB 1.5 MB/s eta 0:00:00
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.2)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.5.18-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777174 sha256=e7f3a9e3e2f8b5374fa3b14ac78a3b71d943eac15e2237ecbb7f1832037a9385
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.3 botocore-1.26.3 cachetools-4.2.4 certifi-2022.5.18 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05284309387207031 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.043047428131103516 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 24.67 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 49s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3fv2l3hib65co
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #90
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/90/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14474] Suppress 'Mean of empty slice' Runtime Warning in dataframe
[noreply] [BEAM-10529] update KafkaIO Xlang integration test to publish and
[noreply] Fix a few small linting bugs (#17695)
[noreply] Bump github.com/lib/pq from 1.10.5 to 1.10.6 in /sdks (#17691)
------------------------------------------
[...truncated 22.97 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.1)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777174 sha256=4933491de00cc66b8eb1fa71903201998c4dffe9aaddfc0b9d0885d6cc4b1cab
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.2 botocore-1.26.2 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.12 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.1 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05539727210998535 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04430651664733887 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 28.61 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 53s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7yu3gjmlbao7y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #89
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/89/display/redirect>
Changes:
------------------------------------------
[...truncated 23.12 KB...]
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.1)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776974 sha256=87889c7cd08bdfb31993452cd9a5237d8d925d39315764932106054831990a0a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.2 botocore-1.26.2 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.047376155853271484 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04438352584838867 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 28.00 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 2s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bl4wcxegicn4e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #88
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/88/display/redirect>
Changes:
------------------------------------------
[...truncated 24.21 KB...]
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776974 sha256=ecad3e82e6d7ccd8058a627dbea3dbc6b3697e4a753f1146d5ddf7b954e15fdb
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.2 botocore-1.26.2 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05039548873901367 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04450678825378418 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 23.30 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
Publishing failed.
The build scan server appears to be unavailable.
Please check https://status.gradle.com for the latest service status.
If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste:
----------
Gradle version: 7.4
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: 6ae75648-1b6c-4028-a677-d2f9f734485c
Response status code: 405
Response server type: Varnish
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #87
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/87/display/redirect>
Changes:
------------------------------------------
[...truncated 24.30 KB...]
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776974 sha256=cfc8820e20ca11a3a4077b268398779a41d6f4016518380bc43e48c2622d66cf
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.2 botocore-1.26.2 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06673359870910645 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03845953941345215 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 22.45 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
Publishing failed.
The build scan server appears to be unavailable.
Please check https://status.gradle.com for the latest service status.
If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste:
----------
Gradle version: 7.4
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: 32832d46-20f4-42e5-96b9-fadf5c1ea9b0
Response status code: 405
Response server type: Varnish
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #86
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/86/display/redirect?page=changes>
Changes:
[mmack] [BEAM-14334] Remove remaining forkEvery 1 from all Spark tests and stop
[Alexey Romanenko] [BEAM-14035] Fix checkstyle issue
[noreply] [BEAM-14441] Automatically assign issue labels based on responses to
[noreply] README update for the Docker Error 255 during Website launch on Apple
[noreply] [BEAM-12000] Update programming-guide.md (#17679)
[noreply] [BEAM-14467] Fix bug where run_pytest.sh does not elevate errors raised
------------------------------------------
[...truncated 24.21 KB...]
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776974 sha256=fb826497cd672c8422dd6a9f90fd8eb1f961ee23881fed29d0c74e1c9c3305ba
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.1 botocore-1.26.1 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05091977119445801 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03966641426086426 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 22.92 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 30s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
Publishing failed.
The build scan server appears to be unavailable.
Please check https://status.gradle.com for the latest service status.
If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste:
----------
Gradle version: 7.4
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: 7fc55562-3a22-4959-8406-edccee3158ac
Response status code: 405
Response server type: Varnish
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #85
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/85/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #17678 from [BEAM-14460] [Playground] WIP. Fix error
------------------------------------------
[...truncated 23.21 KB...]
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.1)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776974 sha256=1bb890007ea32744a14a45aa5a79916887655eafc116b3ca0ffdcad223d3dd44
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.1 botocore-1.26.1 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.0407404899597168 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03738570213317871 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 18 warnings in 20.49 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/y7iwx7gqnaus6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #84
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/84/display/redirect>
Changes:
------------------------------------------
[...truncated 22.99 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776974 sha256=0854bce98d8fe584189f8361bfb7aa28d80873a7288700824a1b3606b7248c67
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.1 botocore-1.26.1 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06029701232910156 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03999185562133789 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 19.90 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 49s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nphc6u2ts7c5s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #83
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/83/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14440] Add basic fuzz tests to the coders package (#17587)
[noreply] [BEAM-14035 ] Implement BigQuerySchema Read/Write TransformProvider
[noreply] Add Akvelon to case-studies (#17611)
[noreply] Merge pull request #17520 from BEAM-12356 Close DatasetService leaked
[noreply] Adding eslint and lint configuration to TypeScript SDK (#17676)
[noreply] Update release-guide.md
[noreply] Update release-guide.md
[noreply] [BEAM-14411] Re-enable TypecodersTest, fix most issues (#17547)
------------------------------------------
[...truncated 22.90 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.3.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2776974 sha256=c9e569f1db4990ff9ed80615a8139e27e8081390ae6cdb5161a85e38d46e0be9
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.1 botocore-1.26.1 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.045549869537353516 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.030872344970703125 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 28.89 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 17s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dfrpardndrbbs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #82
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/82/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13015] Update the SDK harness grouping table to be memory bounded
[noreply] [BEAM-13982] Added output of logging for python E2E pytests (#17637)
[noreply] [BEAM-14473] Throw error if using globally windowed, unbounded side
------------------------------------------
[...truncated 22.92 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=f2c148be846571996c1d0add1d3b3d9c384823112a8a3836ca56a90715d97dff
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.046747684478759766 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0377504825592041 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 22.34 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 44s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7xqe3wst2nzmq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #81
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/81/display/redirect>
Changes:
------------------------------------------
[...truncated 22.99 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=6c7f6c8765e3538fff90f20e6156db895f52d026fd7ad4cba53ec8688bf8eb53
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.08970904350280762 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.037947893142700195 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.23 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 56s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/o2ply5dbcx2za
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #80
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/80/display/redirect>
Changes:
------------------------------------------
[...truncated 23.16 KB...]
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=bd41bc68985267784d17d2fbd73a5e8dfd4fbc8501d884926fc3b892d74d55a8
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.049865007400512695 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0376744270324707 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 18 warnings in 22.28 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ziqdqkwpiwwx4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #79
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/79/display/redirect>
Changes:
------------------------------------------
[...truncated 22.99 KB...]
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=81a86b9583b7128db6231c092f9eb87fd996254e4dab3efff167d4ed93b0eb1d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04940152168273926 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04175448417663574 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.36 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ynguwjd4hxyfm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #78
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/78/display/redirect>
Changes:
------------------------------------------
[...truncated 22.90 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=508091b8552e5500ceb15ab9cdff9804d59349fac46b85fbf470a9e5df6c9d13
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.06063246726989746 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04171109199523926 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 23.47 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 46s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bzm5gbnrbizve
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #77
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/77/display/redirect>
Changes:
------------------------------------------
[...truncated 23.08 KB...]
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=9c0dfa08a7fcf0845aa4dd3e40200ee60701342dd05f6ea3d2a4359c69e3e845
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05608367919921875 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.0362241268157959 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 20.86 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 53s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3u4vlt3ua4z6i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #76
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/76/display/redirect>
Changes:
------------------------------------------
[...truncated 22.99 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=9adf54d10fb23a6604ad13478a2a6b28537172523145ed79ede0bee44abc0b8a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.04986143112182617 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04326915740966797 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.36 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 54s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dlrivk2kajxic
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #75
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/75/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14470] Use Generic Registrations in loadtests. (#17673)
------------------------------------------
[...truncated 22.99 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=f7020477cd62ba932bbdf383201d7c4bb4ac1494140d8743f51cde06416080dc
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.08180785179138184 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04961800575256348 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.95 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 56s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gos3pk5x2r75e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #74
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/74/display/redirect>
Changes:
------------------------------------------
[...truncated 23.04 KB...]
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=0300b9e24fcf0b1d2ad9cce2181b540e9e582eeb6ab4a5787c36d11cb077586d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.049387454986572266 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.039615631103515625 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 22.15 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qothlirnn44ca
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #73
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/73/display/redirect>
Changes:
------------------------------------------
[...truncated 23.00 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=e0b74d2f2ed2b568c1cec99274973059015923d88c3ce4b38509d16103dc85c6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.049620628356933594 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.050891876220703125 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 23.85 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 53s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wg2goomofvacs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #72
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/72/display/redirect>
Changes:
------------------------------------------
[...truncated 22.97 KB...]
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=56b93a25ef8a268737e993f2b006bfe13f4eca8ad7a94e94a692042d94b2643d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05294466018676758 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04059243202209473 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 23.25 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 50s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pz72zq5kge56k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #71
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/71/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14455] Add UUID to sub-schemas for PythonExternalTransform
[Heejong Lee] [BEAM-14430] Adding a logical type support for Python callables to Row
[Heejong Lee] add urn, type inference for PythonCallableSource
[Heejong Lee] fix lint errors
[Heejong Lee] move logical types def
[Heejong Lee] add micros_instant urn
[Heejong Lee] put a default type hint for PythonCallableSource
[Heejong Lee] add comment
[noreply] Merge pull request #17365 from [BEAM-12482] Update Schema Destination
[noreply] [BEAM-14014] Support impersonation credentials in dataflow runner
[noreply] [BEAM-14469] Allow nil primary returns from TrySplit in a single-window
[noreply] Add some auto-starting runners to the typescript SDK. (#17580)
[noreply] [BEAM-14371] (and BEAM-14372) - enable a couple staticchecks (#17670)
------------------------------------------
[...truncated 23.07 KB...]
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2777028 sha256=4f17470ea1432dca508ab457bdd13f89d6ff12c93a542aff9328b8ec9fccd079
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.23.0 botocore-1.26.0 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:136 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:138 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 10 files in 0.05494809150695801 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03683900833129883 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 21.34 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3yakwyqdfmvvc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #70
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/70/display/redirect?page=changes>
Changes:
[noreply] Revert "Better test assertion. (#17551)"
[noreply] Bump github.com/spf13/cobra from 1.3.0 to 1.4.0 in /sdks (#17647)
[noreply] [BEAM-14465] Reduce DefaultS3ClientBuilderFactory logging to debug level
------------------------------------------
[...truncated 23.06 KB...]
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker>=4.0.0
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2773552 sha256=cacf9daa10f609cf621d4f94f1510410c6dc152d1d228aea0b45605ab5e3840c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.13 botocore-1.25.13 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.4 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.0401303768157959 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.04306435585021973 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 23.80 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ffndvitoqk5ci
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #69
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/69/display/redirect?page=changes>
Changes:
[noreply] Drop dataclasses requirement, we only support python 3.7+ (#17640)
------------------------------------------
[...truncated 23.02 KB...]
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2773552 sha256=6b3f8af3ac978539b060e0f1195e04ccca66f27d28ff15b77e0f4cc43826f842
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.13 botocore-1.25.13 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.0474238395690918 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.04411602020263672 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 19.70 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 50s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7urb3iwrlbdeq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #68
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/68/display/redirect?page=changes>
Changes:
[chamikaramj] Updates CHANGES.md to include some recently discovered known issues
[noreply] [BEAM-14347] Add function for simple function registration (#17650)
------------------------------------------
[...truncated 22.96 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2773566 sha256=0c407d21d057ead12d6f37899bdd5f026908419fda807aa5a5fc62bb651d7637
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.13 botocore-1.25.13 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.04250979423522949 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.041878461837768555 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.82 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 39s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ngflwy42k4muk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #67
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/67/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14347] Add generic registration feature to CHANGES (#17643)
[noreply] Better test assertion. (#17551)
[noreply] Bump github.com/google/go-cmp from 0.5.7 to 0.5.8 in /sdks (#17628)
[noreply] Bump github.com/testcontainers/testcontainers-go in /sdks (#17627)
[noreply] Bump github.com/lib/pq from 1.10.4 to 1.10.5 in /sdks (#17626)
[noreply] Merge pull request #17584 from [BEAM-14415] Exception handling tests and
[noreply] Bump cloud.google.com/go/pubsub from 1.18.0 to 1.21.1 in /sdks (#17646)
[noreply] Merge pull request #17408 from [BEAM-14312] [Website] change section
[noreply] Bump cloud.google.com/go/bigquery from 1.28.0 to 1.32.0 in /sdks
------------------------------------------
[...truncated 23.64 KB...]
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Downloading googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 211.7/211.7 kB 27.5 MB/s eta 0:00:00
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2773566 sha256=8ce827af9946ecf63c794715e44762132bc8203d541d323124070755eae3932d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.13 botocore-1.25.13 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.1 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.07107186317443848 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.039843082427978516 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 23.81 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 43s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vbbwksd7rn5ia
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #66
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/66/display/redirect?page=changes>
Changes:
[dannymccormick] [BEAM-14441] Add GitHub issue templates
[dannymccormick] Ask for beam version + other dependencies
[dannymccormick] We don't need outage
[dannymccormick] Cut p4
[noreply] [BEAM-14334] Fix leakage of SparkContext in Spark runner tests to remove
[noreply] Typo & link update (#17633)
[dannymccormick] Pare down to fewer templates
[noreply] Trigger go precommits on go mod/sum changes (#17636)
[noreply] Revert "[BEAM-14429] Force java load test on dataflow runner v2
------------------------------------------
[...truncated 22.91 KB...]
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771561 sha256=756f6e6ff29f12d268fd89cce25b10f8218a91f6898a366872333f682ac7b217
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.12 botocore-1.25.12 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.1.0 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.049358367919921875 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.04157376289367676 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 23.10 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 45s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ztwp2xyh5gv76
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #65
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/65/display/redirect>
Changes:
------------------------------------------
[...truncated 22.88 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771561 sha256=32ae41ae18b9e1348789896e0484d9ca83417bd555d03a3c828cfefc7c9fbcd4
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.12 botocore-1.25.12 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.04947805404663086 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.04416012763977051 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.48 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 24s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/updqpvwx4lcfk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #64
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/64/display/redirect>
Changes:
------------------------------------------
[...truncated 22.91 KB...]
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771561 sha256=7eb603441a59db42abc5bb4412e017fc2a4697c5a51f73890a48a9ab15c44ccc
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.12 botocore-1.25.12 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.06088900566101074 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.04211735725402832 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.81 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 29s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vtj2unycctd4o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #63
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/63/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-14096] bump junit-quickcheck to 1.0
[noreply] [BEAM-12526] Add Dependabot (#17563)
[noreply] Remove python 3.6 postcommit from mass_comment.py (#17630)
[noreply] [BEAM-14347] Add some benchmarks for generic registration (#17613)
[noreply] Correctly route go dependency changes to go label (#17632)
[noreply] [BEAM-13695] Add jamm jvm options to Java 11 (#17178)
------------------------------------------
[...truncated 22.96 KB...]
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.1-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771561 sha256=047c04c50ce2964552be46c0104cd5c88ff9a8a9edf61e80a6767230511614ae
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.12 botocore-1.25.12 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.1 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.1 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.06385540962219238 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.03502607345581055 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.73 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/n2zpkr5vdroku
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #62
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/62/display/redirect?page=changes>
Changes:
[noreply] [BEAM-5492] Python Dataflow integration tests should export the pipeline
[noreply] [BEAM-14396] Bump httplib2 upper bound. (#17602)
[noreply] [BEAM-11104] Add self-checkpointing to CHANGES.md (#17612)
[noreply] [BEAM-14081] [CdapIO] Add context classes for CDAP plugins (#17104)
------------------------------------------
[...truncated 22.99 KB...]
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from httplib2<0.21.0,>=0.8->apache-beam==2.40.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771560 sha256=672df4681075c4c4359aed3b7aa076e6930a85055e87c493a5275130931e9c56
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pytest, pyarrow, pandas, overrides, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.11 botocore-1.25.11 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.057981252670288086 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.03795051574707031 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 35.34 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/m5bxzxtewyc3g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #61
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/61/display/redirect>
Changes:
------------------------------------------
[...truncated 23.13 KB...]
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771396 sha256=c1acb54e1bf402d8bd55e96b526cc4cf610b34443149b250c4df3618aa306699
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.9
Uninstalling pyparsing-3.0.9:
Successfully uninstalled pyparsing-3.0.9
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.11 botocore-1.25.11 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.0432586669921875 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.04031205177307129 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 21.74 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5gd5uuqx6j7pc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #60
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/60/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14347] Rename registration package to register (#17603)
[noreply] [BEAM-11104] Add self-checkpointing integration test (#17590)
------------------------------------------
[...truncated 22.99 KB...]
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771396 sha256=89e1f8d8d84b347f6aa0e3de9c43e52c466be4e4a9ecfba4842e1717473fb872
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.9
Uninstalling pyparsing-3.0.9:
Successfully uninstalled pyparsing-3.0.9
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.11 botocore-1.25.11 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.052530765533447266 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.03903913497924805 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 10 warnings in 23.45 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 37s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/37xkq75r2zjic
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #59
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/59/display/redirect?page=changes>
Changes:
[yathu] [BEAM-14423] Add test cases for BigtableIO.BigtableWriterFn fails due to
[Pablo Estrada] Revert "Merge pull request #17517 from [BEAM-14383] Improve "FailedRows"
[noreply] [BEAM-14229] Fix SyntheticUnboundedSource duplication from checkpoint
------------------------------------------
[...truncated 23.24 KB...]
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771396 sha256=52cdc9c54efd1ac895fd01f379c59274422763d7a49bea980fd73f8e7381091f
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.9
Uninstalling pyparsing-3.0.9:
Successfully uninstalled pyparsing-3.0.9
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.12.0 boto3-1.22.11 botocore-1.25.11 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.05689597129821777 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.056359291076660156 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 10 warnings in 45.63 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 11s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iknngjyobxres
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #58
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/58/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [BEAM-12918] Add PostCommit_Java_Tpcds_Spark job
[johnjcasey] [BEAM-14448] add datastore test
------------------------------------------
[...truncated 23.60 KB...]
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.2.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771942 sha256=bb1cf78322448167e9a641b8d39741196b14bdee4163572eaec774f51aa35950
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.10 botocore-1.25.10 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.0427548885345459 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.03876662254333496 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 26.98 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lugbcyhc3733c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #57
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/57/display/redirect>
Changes:
------------------------------------------
[...truncated 23.51 KB...]
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771945 sha256=a29f0aab8cd2c16f446518c6bf4dc0ade9546d2b1b9abf08a444975f380f5010
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.10 botocore-1.25.10 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.045520782470703125 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.03836202621459961 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 20.56 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2cp7j447paiku
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #56
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/56/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14347] Add generic registration for accumulators (#17579)
------------------------------------------
[...truncated 23.08 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771945 sha256=d826ef75e8b135ce5c8f03c65a7e6e5e467d0a1727cd0e36702bc9229e9b42ce
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.10 botocore-1.25.10 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.054351091384887695 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.05026555061340332 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 20.50 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3reiee3fntptq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #55
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/55/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14429] Force java load test on dataflow runner v2
[noreply] Merge pull request #17577 from [BEAM-14435] Adding exception handling
[noreply] [BEAM-14347] Add generic registration functions for iters and emitters
[noreply] [BEAM-14169] Add Credentials rotation cron job for clusters (#17383)
------------------------------------------
[...truncated 23.47 KB...]
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771945 sha256=3b4df2f6bc15f948e01e4967e755a2f069bfdf2a97e9ea5a186691c6ed555bac
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.10 botocore-1.25.10 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.05278158187866211 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.04096531867980957 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 38.12 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 28s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/d2uispmzkywnw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #54
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/54/display/redirect?page=changes>
Changes:
[andyye333] Add extra details to PubSub matcher errors
[noreply] Merge pull request #17559 from [BEAM-14423] Add exception injection
[noreply] [BEAM-11104] Allow self-checkpointing SDFs to return without finishing
[noreply] Merge pull request #17544 from [BEAM-14415] Exception handling tests for
[noreply] Merge pull request #17565 from [BEAM-14413] add Kafka exception test
[noreply] Merge pull request #17555 from [BEAM-14417] Adding exception handling
[noreply] [BEAM-14433] Improve Go split error message. (#17575)
------------------------------------------
[...truncated 23.91 KB...]
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2771945 sha256=c35534207f449d4be738d0a0dbb4a3ee7cfd1e7911e239c6931a3f59de156222
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.0429840087890625 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.03944826126098633 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 22 warnings in 23.69 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 42s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/obm63xwnjf66y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #53
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/53/display/redirect?page=changes>
Changes:
[elias.segundo] Changing elegibility to AllNodeElegibility
------------------------------------------
[...truncated 23.07 KB...]
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2770580 sha256=883f8e63db8a647e1e153d678a4f44419eba1394a857c8e20c7436476e96c99e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.04793405532836914 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.042069196701049805 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 20.55 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 24s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xrd2nm2hycrsc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #52
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/52/display/redirect>
Changes:
------------------------------------------
[...truncated 22.98 KB...]
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2770580 sha256=114cdc6aed8c0cb073c0cf04fb9f5fabd16f87a9d013d9f81c46ab7d7f28f496
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.06058335304260254 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.03782963752746582 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 10 warnings in 20.48 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 25s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tyufdlljbycho
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #51
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/51/display/redirect?page=changes>
Changes:
[chamikaramj] Adds code reviewers for GCP I/O connectors and KafkaIO to Beam OWNERS
------------------------------------------
[...truncated 23.09 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2770580 sha256=bac6018a76e6f6345e8698d2d318e068f91bd21b7d54a5f6dac17193cbb0e959
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 10 files in 0.04326510429382324 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:582 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:606 Finished listing 1 files in 0.03279924392700195 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 20.66 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vwvzqxesc7gp2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #50
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/50/display/redirect>
Changes:
------------------------------------------
[...truncated 23.60 KB...]
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2769970 sha256=4f6aee069173356a4134d9267bc1d382ccc3461ea0348157aa02501a14c0366d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04653000831604004 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03962135314941406 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 18 warnings in 21.01 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 24s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dt4gobhiee5q6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #49
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/49/display/redirect>
Changes:
------------------------------------------
[...truncated 23.06 KB...]
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2769970 sha256=f4f89e9c334aede7ff036615cc3c99277a8a3a952aa4bd8859c8e5e9152e681d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04442286491394043 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03997516632080078 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 20.80 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7jxcd653nijvi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #48
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/48/display/redirect>
Changes:
------------------------------------------
[...truncated 23.06 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2769970 sha256=d698dd1aec3401caabfe843a18ba165ceab9f437e9b560becd4476fa0fab910d
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04966998100280762 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.033609867095947266 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 20.47 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lwakqtvmayixe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #47
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/47/display/redirect>
Changes:
------------------------------------------
[...truncated 23.49 KB...]
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2769970 sha256=ab0daddcf1db8b4b14d681c1f4c04238c6c0c4cd2e5de4627065091a194eacd3
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.05387544631958008 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03791928291320801 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 21.27 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 26s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vlj2hrkia3lqw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #46
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/46/display/redirect>
Changes:
------------------------------------------
[...truncated 23.06 KB...]
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2769970 sha256=7602e2e7d5b0cf52a5d9a5f8723f7690f2f2973c51808ba8814b8de02dba3e17
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.045136213302612305 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.0398707389831543 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 19.74 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 22s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/u5nom6fag4dum
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #45
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/45/display/redirect>
Changes:
------------------------------------------
[...truncated 23.49 KB...]
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2769970 sha256=febd00939698ea81401a4d2d79d78a8b1666ab1740b72c3fc9ac22c6963575b3
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04521918296813965 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03651857376098633 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 20.42 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rfyujvmqoiajm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #44
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/44/display/redirect?page=changes>
Changes:
[noreply] Quote pip install package name
[noreply] [BEAM-14374] Fix module import error in FullyQualifiedNamedTransform
[Heejong Lee] add test
[Heejong Lee] add test without mock
------------------------------------------
[...truncated 23.06 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2769970 sha256=ce64207c15b58b6f69f6dcd606763bfaf60f384b2a08ea2389203bf2a346cf3a
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.08399558067321777 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.04544568061828613 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 22.02 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 25s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xyy2tkyxgoxh6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #43
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/43/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14146] Python Streaming job failing to drain with BigQueryIO write
[noreply] [BEAM-14332] Refactored cluster management for Flink on Dataproc
[noreply] [BEAM-13988] Update mtime to use time.UnixMilli() calls (#17578)
[noreply] Fixing patching error on missing dependencies (#17564)
[noreply] Merge pull request #17517 from [BEAM-14383] Improve "FailedRows" errors
------------------------------------------
[...truncated 23.94 KB...]
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2769674 sha256=3938be9a276d4544431dbbde60791f3cd840e5a38328f1b53942e27230f700c4
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.24.0 azure-storage-blob-12.11.0 boto3-1.22.9 botocore-1.25.9 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.046000003814697266 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03130054473876953 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 16 warnings in 27.13 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 11s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/eyvwsj32petrg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #42
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/42/display/redirect?page=changes>
Changes:
[kevinsijo] Setting up a basic directory
[kevinsijo] Mirroring Python SDK's directory structure
[kerrydc] Adds initial tests
[kevinsijo] 'runners' is the correct directory name
[Pablo Estrada] sketching the core API for JS SDK
[jonathanlui] add .gitignore for node/ts project
[Robert Bradshaw] Worker directory.
[Robert Bradshaw] Fix complile errors with explicit any for callables.
[Robert Bradshaw] Add worker entry point.
[Robert Bradshaw] Add proto generation code.
[Robert Bradshaw] Add generated proto files.
[Robert Bradshaw] Attempts to get ts protos to compile.
[Robert Bradshaw] Exclude ts protos for now.
[Robert Bradshaw] More changes to get ts protos working.
[Robert Bradshaw] Update scripts and config to get protos compiling.
[Robert Bradshaw] Update geenrated files.
[jonathanlui] add build and clean script to compile ts
[Robert Bradshaw] Generate server for loopback worker.
[Robert Bradshaw] Generated grpc servers for loopback.
[Robert Bradshaw] Add typescript formatter.
[Robert Bradshaw] Loopback server (that does nothing).
[Robert Bradshaw] Working server.
[Pablo Estrada] Starting expansion of primitive transforms
[Pablo Estrada] Starting to implement and support standard coders
[Robert Bradshaw] Also generate grpc clients.
[Robert Bradshaw] Basic implementation of worker harness.
[Pablo Estrada] fix the build
[Robert Bradshaw] Add some missing files for worker harness.
[Robert Bradshaw] Refactor operators to use registration.
[jonathanlui] enable ts in mocha
[jonathanlui] update readme
[jonathanlui] --save-dev @types/mocha
[jonathanlui] translate core_test.js to typescript
[Robert Bradshaw] Encapsulate worker service in a class.
[Kenneth Knowles] Port standard_coders_test to typescript (superficially)
[Pablo Estrada] Starting the proto translation of Impulse, ParDo, GBK
[Robert Bradshaw] Add some tests for the worker code.
[Robert Bradshaw] Fixing old lock file error.
[Pablo Estrada] Adding transform names and fixing GBK coder issue
[Robert Bradshaw] npx tsfmt -r src/apache_beam/base.ts src/apache_beam/transforms/core.ts
[Kenneth Knowles] switch to import style require() statements
[Kenneth Knowles] Add Coder interface using protobufjs classes
[Kenneth Knowles] BytesCoder with some failures
[noreply] Added GeneralObjectCoder and using it as coder for most transforms (#9)
[Kenneth Knowles] Fix order of arguments to deepEqual
[Kenneth Knowles] Encode expected encoding as binary
[Robert Bradshaw] Refactor API to allow for composites.
[jrmccluskey] Initial setup for automated Java expansion startup
[jrmccluskey] Update exp_service.ts
[Kenneth Knowles] Fix up coder deserialization
[Robert Bradshaw] Simplify GBK coder computation.
[Robert Bradshaw] Remove top-level PValue.
[Pablo Estrada] Make tests green
[Robert Bradshaw] Rename PValueish to PValue.
[jonathanlui] node runner
[jonathanlui] whitespaces
[Robert Bradshaw] Make Runner.run async.
[jonathanlui] bson and fast-deep-equal should not be listed as devdependency
[jrmccluskey] Add basic Dockerfile that starts ExternalWorkerPool
[Robert Bradshaw] Direct runner.
[kevinsijo] Testing expansion service communication
[Robert Bradshaw] Added flatten, assertion checkers.
[Pablo Estrada] progress on basic coders
[Robert Bradshaw] Fixing the build.
[Robert Bradshaw] Cleanup, simplify access.
[Pablo Estrada] Adding limited support for KVCoder and IterableCoder
[Robert Bradshaw] Introduce PipelineContext.
[Robert Bradshaw] Add toProto to all coders.
[Robert Bradshaw] Some work with coders.
[Robert Bradshaw] Remove debug logging.
[Robert Bradshaw] Use coders over data channel.
[Kenneth Knowles] explicitly sequence sub-coder serializations
[Kenneth Knowles] no more need to extend FakeCoder
[Kenneth Knowles] actually advance reader
[Kenneth Knowles] autoformat
[Kenneth Knowles] protobufjs already can write and read signed varints
[Kenneth Knowles] with improved test harness, kv has many more failures
[Kenneth Knowles] read bytescoder from correct position
[Kenneth Knowles] no more fake coders
[Kenneth Knowles] varint examples all work
[Kenneth Knowles] simplify coder value parsing
[Kenneth Knowles] global window coder
[Kenneth Knowles] fix swapEndian32
[Robert Bradshaw] Add P(...) operator.
[kevinsijo] Implementing RowCoder encoding.
[jrmccluskey] remove unused container dir
[kevinsijo] Corrected sorting of encoded positions to reflect an argsort instead.
[Robert Bradshaw] Populate environments.
[kevinsijo] Implementing RowCoder decoding.
[Kenneth Knowles] preliminary unbounded iterable coder
[Kenneth Knowles] friendlier description of standard coder test case
[Kenneth Knowles] fix test harness; iterable works
[jrmccluskey] first pass at boot.go
[jonathanlui] update package-lock.json
[jonathanlui] make NodeRunner a subclass of Runner
[jonathanlui] add waitUntilFinish interface member
[Pablo Estrada] Adding double coder
[Kenneth Knowles] scaffolding for windowed values
[Pablo Estrada] Adding type information to PColleciton and PTransform
[jonathanlui] fix direct runner
[Pablo Estrada] Adding typing information for DoFns
[Kenneth Knowles] add interval window
[Robert Bradshaw] Export PValue.
[Robert Bradshaw] Add CombineFn interface.
[Robert Bradshaw] Typed flatten.
[jonathanlui] add runAsync method to base.Runner
[Kenneth Knowles] add Long package
[Pablo Estrada] Adding more types. Making PValue typed
[Kenneth Knowles] instant coder draft
[Robert Bradshaw] Return job state from direct runner.
[Kenneth Knowles] type instant = long
[jonathanlui] implement NodeRunner.runPipeline
[Kenneth Knowles] autoformat
[kevinsijo] Completed implementation of basic row coder
[Kenneth Knowles] Fix IntervalWindowCoder, almost
[Kenneth Knowles] fix interval window coder
[Kenneth Knowles] autoformat
[Robert Bradshaw] loopback runner works
[Kenneth Knowles] move core element types into values.ts
[Kenneth Knowles] just build object directly to be cool
[Robert Bradshaw] GBK working on ULR.
[Robert Bradshaw] Async transforms.
[Robert Bradshaw] External transform grpah splicing.
[Kenneth Knowles] progress on windowed value: paneinfo encoding
[Robert Bradshaw] Fix merge.
[Robert Bradshaw] autoformat
[Kenneth Knowles] full windowed value coder
[kerrydc] Updates tests to use correct types, adds generics where needed to DoFns
[Robert Bradshaw] Add serialization librarires.'
[Robert Bradshaw] Add Split() PTransform, for producing multiple outputs from a single
[Robert Bradshaw] Schema-encoded external payloads.
[kevinsijo] Adding Schema inference from JSON
[Pablo Estrada] Removing unused directories
[Pablo Estrada] Support for finishBundle and improving typing annotations.
[Pablo Estrada] A base implementation of combiners with GBK/ParDo
[Robert Bradshaw] Fully propagate windowing information in both remote and direct runner.
[Robert Bradshaw] Make args and kwargs optional for python external transform.
[Robert Bradshaw] Infer schema for external transforms.
[Pablo Estrada] Implementing a custom combine fn as an example. Small fixes
[Robert Bradshaw] Fix missing windowing information in combiners.
[Robert Bradshaw] PostShuffle needn't group by key as that's already done.
[Robert Bradshaw] Guard pre-combine for global window only.
[Robert Bradshaw] WindowInto
[Robert Bradshaw] Fix optional kwargs.
[Robert Bradshaw] A couple of tweaks for js + py
[Robert Bradshaw] Add windowing file.
[Robert Bradshaw] CombineBy transform, stand-alone WordCount.
[Robert Bradshaw] cleanup
[Robert Bradshaw] Actually fix optional external kwargs.
[Robert Bradshaw] Demo2, textio read.
[Robert Bradshaw] Add command lines for starting up the servers.
[Robert Bradshaw] Run prettier on the full codebase.
[Robert Bradshaw] Update deps.
[Pablo Estrada] Adding docstrings for core.ts. Prettier dependency
[Pablo Estrada] Documenting coder interfaces
[Pablo Estrada] Added documentation for a few standard coders
[Robert Bradshaw] Unified grouping and combining.
[Robert Bradshaw] Allow PCollection ids to be lazy.
[Robert Bradshaw] Reorganize module structure.
[Robert Bradshaw] A couple more renames.
[Robert Bradshaw] Simplify.
[Robert Bradshaw] Consolidation.
[Robert Bradshaw] Fix build.
[Robert Bradshaw] Add optional context to ParDo.
[Robert Bradshaw] fixup: iterable coder endian sign issue
[Robert Bradshaw] omit context for map(console.log)
[Robert Bradshaw] Fix ReadFromText coders.
[Robert Bradshaw] Flesh out README with overview and current state.
[noreply] Readme typo
[Robert Bradshaw] Two more TODOs.
[noreply] Add a pointer to the example wordcount to the readme.
[Pablo Estrada] Documenting coders and implementing unknown-length method
[Robert Bradshaw] UIID dependency.
[Robert Bradshaw] Artifact handling.
[Robert Bradshaw] Properly wait on data channel for bundle completion.
[Robert Bradshaw] Automatic java expansion service startup.
[Robert Bradshaw] Process promises.
[Robert Bradshaw] Implement side inputs.
[Robert Bradshaw] Cleanup.
[Robert Bradshaw] Put complex constext stuff in its own file.
[Robert Bradshaw] Rename BoundedWindow to just Window.
[Robert Bradshaw] Alternative splitter class.
[Pablo Estrada] Documenting internal functions
[Robert Bradshaw] Take a pass clarifying the TODOs.
[Robert Bradshaw] Sql transform wrapper.
[Robert Bradshaw] Incorporate some feedback into the TODOs.
[Robert Bradshaw] More TODOs.
[Robert Bradshaw] Remove app placeholder.
[Robert Bradshaw] Apache license headers.
[Robert Bradshaw] More TODOs
[jankuehle] Suggestions for TypeScript todos
[dannymccormick] Add actions for typescript sdk
[dannymccormick] Fix test command
[noreply] Add missing version
[dannymccormick] Fix codecovTest command
[noreply] Only do prettier check on linux
[noreply] Only get codecov on linux
[Robert Bradshaw] Resolve some comments.
[Robert Bradshaw] Fix compile errors.
[Robert Bradshaw] Prettier.
[Robert Bradshaw] Re-order expandInternal arguments pending unification.
[Robert Bradshaw] More consistent and stricter PTransform naming.
[Robert Bradshaw] Notes on explicit, if less idiomatic, use of classes.
[Robert Bradshaw] Let DoFn be an interface rather than a class.
[Robert Bradshaw] Provide DoFn context to start and finish bundle.
[Robert Bradshaw] Optional promise code simplification.
[Robert Bradshaw] Cleanup todos.
[Robert Bradshaw] Avoid any type where not needed.
[Robert Bradshaw] Apache RAT excludes for typescript.
[Robert Bradshaw] Remove empty READMEs.
[Robert Bradshaw] Add licences statement to readme files.
[Robert Bradshaw] More RAT fixes.
[Robert Bradshaw] Another unsupported coder.
[Robert Bradshaw] Remove debugging code.
[noreply] Fix automatic naming with code coverage.
[Robert Bradshaw] Coders cleanup.
[Robert Bradshaw] Add tests for RowCoder.
[Robert Bradshaw] Normalize capitalization, comments.
[Robert Bradshaw] Install typescript closure packages.
[Robert Bradshaw] npm audit fix
[Robert Bradshaw] Move more imports out of base.
[Robert Bradshaw] Changes needed to compile with ts closure plugin.
[Robert Bradshaw] Use ttsc and ts-closure-transform plugin.
[Robert Bradshaw] Serialization registration to actually get serialization working.
[Robert Bradshaw] Container images working on local runner.
[Robert Bradshaw] Add a portable job server that proxies the Dataflow backend. (#17189)
[Robert Bradshaw] Improvements to dataflow job service for non-Python jobs.
[Robert Bradshaw] Get dataflow working.
[Robert Bradshaw] User friendly pipeline options.
[Robert Bradshaw] Less classes, more functions.
[Robert Bradshaw] Add new nullable standard coder.
[Robert Bradshaw] Make Apache Rat happy.
[Robert Bradshaw] Disable broken codecov.
[Robert Bradshaw] Remove last uses of base.ts.
[Robert Bradshaw] Remove unneedd file.
[Robert Bradshaw] Remove more uneeded/unused files.
[Robert Bradshaw] Cleanup tests.
[Robert Bradshaw] Minor cleanups to coder tests.
[Robert Bradshaw] Addressing issues from the review.
[noreply] Apply suggestions from code review.
[Robert Bradshaw] Post-merge fixes.
[dannymccormick] Delete tags.go
[Robert Bradshaw] Update tests to use our actual serialization libraries.
[Robert Bradshaw] Another pass at TODOs, removing finished items.
[Kenneth Knowles] Add parameter for service account impersonation in GCP credentials
[noreply] Merge pull request #17490 from [BEAM-14370] [Website] Add new page about
------------------------------------------
[...truncated 23.37 KB...]
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.13.0-py3-none-any.whl (51 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2766955 sha256=b2bfc7ac31a205eac69e213f6f254af24523fa0b4529eee94f44ef3107484a4e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.8 botocore-1.25.8 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.13.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.050867319107055664 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03984999656677246 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 22.40 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 26s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jrmcyukoktg3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #41
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/41/display/redirect>
Changes:
------------------------------------------
[...truncated 23.23 KB...]
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2766904 sha256=e23735931da6dc6912bc33de873e810de8ae7249338207e411c5d67b5f3ebcf5
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.8 botocore-1.25.8 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.05602717399597168 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.038573265075683594 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 22.34 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 25s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2earfh42o6tmi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #40
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/40/display/redirect?page=changes>
Changes:
[noreply] [BEAM-5878] Add (failing) kwonly-argument test (#17509)
------------------------------------------
[...truncated 23.18 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2766904 sha256=110214e4091d18ea1baaf5678476d8a98e28dffb67b51fe239a1b7816a67c81c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.8 botocore-1.25.8 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04865002632141113 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.04163932800292969 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 23.02 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 33s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fxmwndlkya7xm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #39
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/39/display/redirect?page=changes>
Changes:
[noreply] Upgrade python sdk container requirements. (#17549)
[noreply] Merge pull request #17497: [BEAM-11205] Update GCP Libraries BOM version
[noreply] [BEAM-12603] Add retry on grpc data channel and remove retry from test.
[noreply] Merge pull request #17359: [BEAM-14303] Add a way to exclude output
[noreply] [BEAM-14347] Allow users to optimize DoFn execution with a single
------------------------------------------
[...truncated 23.50 KB...]
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2766828 sha256=9fb30b77ab0ee37fc0e3f14efa9c11d4bf161cda1d80c5f869835591ad65a3f5
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.8 botocore-1.25.8 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.049738168716430664 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.0427861213684082 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 23.71 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 44s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hdm2tn2rjq2yu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #38
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/38/display/redirect?page=changes>
Changes:
[zyichi] Move master readme.md to 2.40.0
[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink
------------------------------------------
[...truncated 23.31 KB...]
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2766392 sha256=88e6e8bdf654703de3ab85e0b7f247b4d0867dee11aa939bf900ec533b1af125
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.7 botocore-1.25.7 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.05287313461303711 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.04755544662475586 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 22.87 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 41s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mnuuxz27jxmuw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #37
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/37/display/redirect?page=changes>
Changes:
[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle
[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling
------------------------------------------
[...truncated 23.19 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2766392 sha256=f515715fe2e07e44f7982b8411f73d539711c5a0b3027fb69c630bd2ef1f82a6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.7 botocore-1.25.7 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.9.0 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.0455472469329834 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.038790225982666016 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 22.11 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 50s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nrorxmbiaokrg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #36
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/36/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs
------------------------------------------
[...truncated 23.31 KB...]
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2766392 sha256=70ff9450d50f5e456cef982b9acb6c4837e498b869cbc5b946e29b71e09d4a65
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.7 botocore-1.25.7 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04181790351867676 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03305554389953613 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 21.46 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 34s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/waevgsdwzdmeu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #35
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/35/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict
[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html
[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section
[ahmedabualsaud] fix test decotrator typo
[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations
[noreply] re-add testing package to pydoc (#17524)
[Heejong Lee] add test
[noreply] [BEAM-14250] Amended the workaround (#17531)
[noreply] [BEAM-11104] Fix broken split result validation (#17546)
[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)
[noreply] Merge pull request #17417: [BEAM-14388] Address some performance
[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)
[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)
[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.
------------------------------------------
[...truncated 23.26 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.40.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.40.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.40.0.dev0) (1.11.0)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.40.0.dev0-py3-none-any.whl size=2766392 sha256=1fee732a759bbaebd4ce5e010de79443a5a5f544fdd113455bb21025b91db845
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.40.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.7 botocore-1.25.7 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.05349254608154297 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.035419464111328125 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 21.12 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 36s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zo5bhjvcfth4u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #34
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/34/display/redirect?page=changes>
Changes:
[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template
[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff
------------------------------------------
[...truncated 24.12 KB...]
Using cached grpcio_status-1.46.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2759580 sha256=70e151bd23e4a9dd3ba71185246683107c56440a2a714e56737a31d6ed4a58c4
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.6 botocore-1.25.6 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.046616315841674805 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03936409950256348 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.it_postcomit - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 20 warnings in 20.37 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 26s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ue6abpkfjzt5o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #33
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/33/display/redirect?page=changes>
Changes:
[noreply] add __Init__ to inference. (#17514)
------------------------------------------
[...truncated 24.13 KB...]
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2759580 sha256=552ed8994c72a94dd6b25f4560d443bbd37203d2d8f2df55e157f015dbb829ca
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.6 botocore-1.25.6 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.46.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.051995277404785156 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.04114532470703125 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.it_postcomit - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 22 warnings in 20.69 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 23s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yaneknya77dgg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #32
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/32/display/redirect?page=changes>
Changes:
[noreply] fix: JDBC config schema fields order
[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.
[noreply] [BEAM-11106] Support drain in Go SDK (#17432)
------------------------------------------
[...truncated 24.23 KB...]
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2745322 sha256=dd936a9ad78fbe6eb9fea0adde220f5a4519ee1dfc7a11a9813f3f38ea177e5c
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.6 botocore-1.25.6 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04426932334899902 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.03990793228149414 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.it_postcomit - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 24 warnings in 20.95 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 24s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ntlbrxsatyenk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #31
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/31/display/redirect?page=changes>
Changes:
[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"
[Brian Hulette] BEAM-14231: bypass schema cache for
[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)
[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ
[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to
[noreply] [BEAM-14064] fix es io windowing (#17112)
[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)
[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test
------------------------------------------
[...truncated 23.77 KB...]
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.39.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.44.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2745321 sha256=7c264af6997cd87eb23038554f12063cc88f6f6103110e7e757678bb0c44ca5e
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.6 botocore-1.25.6 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04985928535461426 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.04884958267211914 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.it_postcomit - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
warnings.warn(
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 18 warnings in 23.16 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 27s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/echoghtywg5ie
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #30
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/30/display/redirect>
Changes:
------------------------------------------
[...truncated 23.22 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.39.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.39.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.44.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2740861 sha256=3d31684fc0b19aeaa22a3f465e13f0d316218c0a84f142dbdf65968b1f2e540f
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.5 botocore-1.25.5 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.0490567684173584 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.037233591079711914 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 14 warnings in 22.33 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 30s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qs5i6ilygqhu6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #29
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/29/display/redirect>
Changes:
------------------------------------------
[...truncated 23.11 KB...]
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.39.0.dev0) (21.3)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.39.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.44.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2740861 sha256=c11c1af4e482953399d807969326af903672ee39c5a1e845c380c884dcea0cc6
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.5 botocore-1.25.5 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.04280400276184082 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.04062819480895996 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 20.30 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 22s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/e4pnibixoggj6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #28
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/28/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated
------------------------------------------
[...truncated 23.28 KB...]
Using cached google_api_core-2.7.3-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.39.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.44.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2740861 sha256=7d268b93349da49125c52c2e8b84f75a54a3c1e4491410f5219a84731db0a7b2
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.5 botocore-1.25.5 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw0] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 10 files in 0.046154022216796875 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Starting the file information of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:600 Finished listing 1 files in 0.04918670654296875 seconds.
[33m=============================== warnings summary ===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 21.10 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 22s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/eq3ozhgmzyrlc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Sickbay_Python38 #27
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/27/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Allow arithmetic between deferred scalars.
[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow
[noreply] Add website link log to notify user of pre-build workflow. (#17498)
[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)
[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python
[noreply] [BEAM-10265] Display error message if trying to infer recursive schema
[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)
[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation
------------------------------------------
[...truncated 23.17 KB...]
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.39.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting google-api-core<2.0.0dev,>=1.21.0
Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.39.0.dev0) (62.1.0)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.44.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.39.0.dev0) (1.11.0)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting scipy>=1.1.0
Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.56.0-py2.py3-none-any.whl (241 kB)
Collecting google-api-core[grpc,grpcgcp]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.7.2-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.7.0-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.1-py3-none-any.whl (114 kB)
Using cached google_api_core-2.6.0-py2.py3-none-any.whl (114 kB)
Using cached google_api_core-2.5.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB)
Using cached google_api_core-2.3.2-py2.py3-none-any.whl (109 kB)
Collecting google-crc32c<2.0dev,>=1.0
Using cached google_crc32c-1.3.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting typing-utils>=0.0.3
Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.2-py3-none-any.whl (54 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.39.0.dev0-py3-none-any.whl size=2738254 sha256=20fd6c8d5ce9ff2262c2c44032904a36b2a1970579078170c03c9af16e755ec2
Stored in directory: /home/jenkins/.cache/pip/wheels/7d/37/4c/0c7304293fde69e6afbf9dad246857452edc4251c785c2fa5a
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, typing-extensions, threadpoolctl, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pluggy, pbr, orjson, oauthlib, numpy, more-itertools, joblib, jmespath, isodate, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, atomicwrites, sqlalchemy, scipy, requests, pydot, pyarrow, pandas, overrides, mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, oauth2client, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-api-core, docker, deprecation, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.8
Uninstalling pyparsing-3.0.8:
Successfully uninstalled pyparsing-3.0.8
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.39.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.1 azure-storage-blob-12.11.0 boto3-1.22.5 botocore-1.25.5 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-37.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.11 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.3 google-cloud-bigquery-storage-2.13.1 google-cloud-bigtable-1.7.1 google-cloud-core-1.7.2 google-cloud-datastore-1.15.4 google-cloud-dlp-3.6.2 google-cloud-language-1.3.1 google-cloud-pubsub-2.12.0 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.2 google-cloud-videointelligence-1.16.2 google-cloud-vision-1.0.1 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.7.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 joblib-1.1.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.8 overrides-6.1.0 pandas-1.4.2 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2022.1 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 scikit-learn-1.0.2 scipy-1.8.0 sqlalchemy-1.4.36 tenacity-5.1.5 testcontainers-3.5.3 threadpoolctl-3.1.0 typing-extensions-4.2.0 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.2 wrapt-1.14.1
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=it_postcommit_sickbay
[1m============================= test session starts ==============================[0m
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw0] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw2] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw3] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw4] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw6] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw5] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0m[1m[gw7] Python 3.8.10 (default, Mar 15 2022, 12:22:08) -- [GCC 9.4.0]
[0mgw0 [2] / gw1 [2] / gw2 [2] / gw3 [2] / gw4 [2] / gw5 [2] / gw6 [2] / gw7 [2]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_batch_rewrite_token
apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
[gw1] [31mFAILED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy_rewrite_token
=================================== FAILURES ===================================
[31m[1m______________ GcsIOIntegrationTest.test_copy_batch_rewrite_token ______________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_batch_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall[0m
[1m def test_copy_batch_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy_batch([0m
[1m "test_copy_batch_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:198: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:122 Setting socket default timeout to 60 seconds.
[32mINFO [0m apache_beam.internal.gcp.auth:auth.py:124 socket default timeout is 60.0 seconds.
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:563 Starting the size estimation of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Finished listing 10 files in 0.051048994064331055 seconds.
[31m[1m_________________ GcsIOIntegrationTest.test_copy_rewrite_token _________________[0m
[gw1] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/bin/python3.8>
self = <apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest testMethod=test_copy_rewrite_token>
[1m @pytest.mark.it_postcommit_sickbay[0m
[1m #@pytest.mark.it_postcommit BEAM-12352 maxBytesRewrittenPerCall '[0m
[1m def test_copy_rewrite_token(self):[0m
[1m # Tests a multi-part copy (rewrite) operation. This is triggered by a[0m
[1m # combination of 3 conditions:[0m
[1m # - a large enough src[0m
[1m # - setting max_bytes_rewritten_per_call[0m
[1m # - setting kms_key_name[0m
[1m if self.kms_key_name is None:[0m
[1m raise unittest.SkipTest('--kms_key_name not specified')[0m
[1m [0m
[1m rewrite_responses = [][0m
[1m self.gcsio._set_rewrite_response_callback([0m
[1m lambda response: rewrite_responses.append(response))[0m
[1m self._test_copy([0m
[1m "test_copy_rewrite_token",[0m
[1m kms_key_name=self.kms_key_name,[0m
[1m max_bytes_rewritten_per_call=50 * 1024 * 1024,[0m
[1m src=self.INPUT_FILE_LARGE)[0m
[1m # Verify that there was a multi-part rewrite.[0m
[1m> self.assertTrue(any(not r.done for r in rewrite_responses))[0m
[1m[31mE AssertionError: False is not true[0m
[1m[31mapache_beam/io/gcp/gcsio_integration_test.py[0m:144: AssertionError
------------------------------ Captured log call -------------------------------
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:563 Starting the size estimation of the input
[32mINFO [0m apache_beam.io.gcp.gcsio:gcsio.py:576 Finished listing 1 files in 0.04488325119018555 seconds.
[33m=============================== warnings summary ===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> -
[31m[1m============== 2 failed, 1 skipped, 12 warnings in 34.89 seconds ===============[0m
> Task :sdks:python:test-suites:dataflow:py38:postCommitSickbay FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Sickbay_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitSickbay'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 31s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iltbr7ntyh5pg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org