You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/10/15 20:08:08 UTC

Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Dataflow #807

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/807/display/redirect>

Changes:


------------------------------------------
[...truncated 254.77 KB...]
    + which python
    + which pip

                                                                       ✓ 0.13s
Building wheel...

    + rm -rf /tmp/cibuildwheel/built_wheel
    + mkdir -p /tmp/cibuildwheel/built_wheel
    + python -m pip wheel /project --wheel-dir=/tmp/cibuildwheel/built_wheel --no-deps

> Task :sdks:python:test-suites:dataflow:py311:installGcpTest
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): finished with status 'done'
  Created wheel for apache-beam: filename=apache_beam-2.52.0.dev0-cp311-cp311-linux_x86_64.whl size=15427406 sha256=382c1f3dbc20510eb81e0fd53d358b416721cfb1f63f275e9bf2806bcf916af2
  Stored in directory: /home/jenkins/.cache/pip/wheels/e4/5c/da/6329b44131b6caad3634eee5a8a0f000d8cb8a636243c55eec
Successfully built apache-beam
Installing collected packages: sortedcontainers, pytz, pyjsparser, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, tzlocal, typing-extensions, threadpoolctl, tenacity, sqlparse, six, regex, pyyaml, pyparsing, pymysql, PyJWT, pyhamcrest, pycparser, pyasn1, psycopg2-binary, protobuf, portalocker, parameterized, overrides, orjson, objsize, numpy, mock, joblib, jmespath, iniconfig, idna, grpcio, greenlet, google-crc32c, fasteners, fastavro, execnet, dnspython, dill, deprecation, cloudpickle, charset-normalizer, certifi, attrs, sqlalchemy, shapely, scipy, rsa, requests, python-dateutil, pytest, pymongo, pydot, pyasn1-modules, pyarrow, proto-plus, js2py, isodate, hypothesis, httplib2, googleapis-common-protos, google-resumable-media, cffi, scikit-learn, requests-mock, pytest-xdist, pytest-timeout, pandas, oauth2client, hdfs, grpcio-status, google-auth, freezegun, docker, cryptography, botocore, azure-core, testcontainers, s3transfer, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, azure-storage-blob, apache-beam, msal, google-cloud-core, boto3, msal-extensions, google-cloud-vision, google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-pubsublite, google-cloud-aiplatform, azure-identity

> Task :sdks:python:bdistPy311linux

[notice] A new release of pip available: 22.2.2 -> 23.3
[notice] To update, run: pip install --upgrade pip
Processing /project
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: apache-beam
  Building wheel for apache-beam (pyproject.toml): started
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): finished with status 'done'
  Created wheel for apache-beam: filename=apache_beam-2.52.0.dev0-cp311-cp311-linux_x86_64.whl size=15798977 sha256=a66115698ee71d5de0490611e9e5be6545c48ce96699b1d57ccef5294159bd83
  Stored in directory: /tmp/pip-ephem-wheel-cache-vg1l4ksd/wheels/aa/0c/49/7c4d39428e78274ff9f1db5b9c539aa0d6bd6becda70207fa7
Successfully built apache-beam
    + /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob; json.dump(glob.glob('"'"'/tmp/cibuildwheel/built_wheel/*.whl'"'"'), sys.stdout)'
    + rm -rf /tmp/cibuildwheel/repaired_wheel
    + mkdir -p /tmp/cibuildwheel/repaired_wheel

                                                                     ✓ 231.94s
Repairing wheel...

    + sh -c 'auditwheel repair -w /tmp/cibuildwheel/repaired_wheel /tmp/cibuildwheel/built_wheel/apache_beam-2.52.0.dev0-cp311-cp311-linux_x86_64.whl'
INFO:auditwheel.main_repair:Repairing apache_beam-2.52.0.dev0-cp311-cp311-linux_x86_64.whl
INFO:auditwheel.wheeltools:Previous filename tags: linux_x86_64
INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_x86_64, manylinux2014_x86_64
INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp311-cp311-linux_x86_64
INFO:auditwheel.wheeltools:New WHEEL info tags: cp311-cp311-manylinux_2_17_x86_64, cp311-cp311-manylinux2014_x86_64
INFO:auditwheel.main_repair:
Fixed-up wheel written to /tmp/cibuildwheel/repaired_wheel/apache_beam-2.52.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
    + /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob; json.dump(glob.glob('"'"'/tmp/cibuildwheel/repaired_wheel/*.whl'"'"'), sys.stdout)'
    + mkdir -p /output
    + mv /tmp/cibuildwheel/repaired_wheel/apache_beam-2.52.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl /output

                                                                       ✓ 6.18s

✓ cp311-manylinux_x86_64 finished in 238.36s
Copying wheels back to host...


                                                                       ✓ 0.15s

1 wheels produced in 5 minutes:
  apache_beam-2.52.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl   15,445 kB

> Task :sdks:python:bdistPy38linux
Requirement already satisfied: cibuildwheel==2.9.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (2.9.0)
Requirement already satisfied: bashlex!=0.13 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (0.18)
Requirement already satisfied: bracex in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (2.4)
Requirement already satisfied: certifi in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (2023.7.22)
Requirement already satisfied: filelock in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (3.12.4)
Requirement already satisfied: packaging>=20.9 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (23.2)
Requirement already satisfied: platformdirs in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (3.11.0)
Requirement already satisfied: tomli in <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (2.0.1)
WARNING: There was an error checking the latest version of pip.
cp38-manylinux_x86_64

     _ _       _ _   _       _           _
 ___|_| |_ _ _|_| |_| |_ _ _| |_ ___ ___| |
|  _| | . | | | | | . | | | |   | -_| -_| |
|___|_|___|___|_|_|___|_____|_|_|___|___|_|

cibuildwheel version 2.9.0

Build options:
  platform: 'linux'
  architectures: {<Architecture.x86_64: 'x86_64'>, <Architecture.i686: 'i686'>}
  build_selector: {'build_config': 'cp38-manylinux_*64*', 'skip_config': '', 'requires_python': None, 'prerelease_pythons': False}
  container_engine: 'docker'
  output_dir: PosixPath('<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/sdks/python/build')>
  package_dir: PosixPath('<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/sdks/python')>
  test_selector: {'skip_config': ''}
  before_all: ''
  before_build: ''
  before_test: ''
  build_frontend: 'pip'
  build_verbosity: 0
  dependency_constraints: DependencyConstraints(PosixPath('<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/cibuildwheel/resources/constraints.txt'))>
  environment: {'assignments': [SETUPTOOLS_USE_DISTUTILS=stdlib]}
    cp38-manylinux_x86_64: ParsedEnvironment(['SETUPTOOLS_USE_DISTUTILS=stdlib'])
  manylinux_images: {'x86_64': 'quay.io/pypa/manylinux2014_x86_64:2022-08-09-51a01be', 'i686': 'quay.io/pypa/manylinux2014_i686:2022-08-09-51a01be', 'pypy_x86_64': 'quay.io/pypa/manylinux2014_x86_64:2022-08-09-51a01be', 'aarch64': 'quay.io/pypa/manylinux2014_aarch64:2022-08-09-51a01be', 'ppc64le': 'quay.io/pypa/manylinux2014_ppc64le:2022-08-09-51a01be', 's390x': 'quay.io/pypa/manylinux2014_s390x:2022-08-09-51a01be', 'pypy_aarch64': 'quay.io/pypa/manylinux2014_aarch64:2022-08-09-51a01be', 'pypy_i686': 'quay.io/pypa/manylinux2014_i686:2022-08-09-51a01be'}
  musllinux_images: {'x86_64': 'quay.io/pypa/musllinux_1_1_x86_64:2022-08-09-51a01be', 'i686': 'quay.io/pypa/musllinux_1_1_i686:2022-08-09-51a01be', 'aarch64': 'quay.io/pypa/musllinux_1_1_aarch64:2022-08-09-51a01be', 'ppc64le': 'quay.io/pypa/musllinux_1_1_ppc64le:2022-08-09-51a01be', 's390x': 'quay.io/pypa/musllinux_1_1_s390x:2022-08-09-51a01be'}
  repair_command: 'auditwheel repair -w {dest_dir} {wheel}'
  test_command: ''
  test_extras: ''
  test_requires: []
Cache folder: /home/jenkins/.cache/cibuildwheel

Here we go!

Starting container image quay.io/pypa/manylinux2014_x86_64:2022-08-09-51a01be...

info: This container will host the build for cp38-manylinux_x86_64...
503edd07b0ff24e6dd3ec758a606a1ff903ffc07cfd7052a22f29bae38349896
    + /bin/true
    + mkdir -p /project

                                                                       ✓ 0.83s
Copying project into container...

    + mkdir -p /project

                                                                       ✓ 0.24s

Building cp38-manylinux_x86_64 wheel
CPython 3.8 manylinux x86_64

Setting up build environment...

    + /opt/python/cp38-cp38/bin/python -c 'import sys, json, os; json.dump(os.environ.copy(), sys.stdout)'
    + which python
    + which pip

                                                                       ✓ 0.13s
Building wheel...

    + rm -rf /tmp/cibuildwheel/built_wheel
    + mkdir -p /tmp/cibuildwheel/built_wheel
    + python -m pip wheel /project --wheel-dir=/tmp/cibuildwheel/built_wheel --no-deps

> Task :sdks:python:test-suites:dataflow:py311:installGcpTest
Successfully installed PyJWT-2.8.0 apache-beam-2.52.0.dev0 attrs-23.1.0 azure-core-1.29.4 azure-identity-1.15.0b2 azure-storage-blob-12.18.3 boto3-1.28.63 botocore-1.31.63 certifi-2023.7.22 cffi-1.16.0 charset-normalizer-3.3.0 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.4 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 docopt-0.6.2 execnet-2.0.2 fastavro-1.8.4 fasteners-0.19 freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31 google-auth-2.23.3 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.35.0 google-cloud-bigquery-3.12.0 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3 google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5 google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1 google-cloud-storage-2.12.0 google-cloud-videointelligence-2.11.4 google-cloud-vision-3.4.4 google-crc32c-1.5.0 google-resumable-media-2.6.0 googleapis-common-protos-1.61.0 greenlet-3.0.0 grpc-google-iam-v1-0.12.6 grpcio-1.59.0 grpcio-status-1.59.0 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.87.4 idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.9 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 portalocker-2.8.2 proto-plus-1.22.3 protobuf-4.24.4 psycopg2-binary-2.9.9 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.0.4 pyjsparser-2.7.1 pymongo-4.5.0 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.2 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 regex-2023.10.3 requests-2.31.0 requests-mock-1.11.0 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.1 scipy-1.11.3 shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.49 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.8.0 tzlocal-5.1 urllib3-2.0.6 websocket-client-1.6.4 wrapt-1.16.0rc1 zstandard-0.21.0

> Task :sdks:python:test-suites:dataflow:py311:initializeForDataflowJob

> Task :sdks:python:test-suites:dataflow:py311:gcpCrossLanguageSetup
Launching Java expansion service @ 43457
Launching Python expansion service @ 
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/ws/src/sdks/python/scripts/run_expansion_services.sh>: line 128: /bin/activate: No such file or directory

> Task :sdks:python:test-suites:dataflow:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 3327002.
Stopping expansion service pid: 3327003.

> Task :sdks:python:bdistPy38linux

[notice] A new release of pip available: 22.2.2 -> 23.3
[notice] To update, run: pip install --upgrade pip
Processing /project
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: apache-beam
  Building wheel for apache-beam (pyproject.toml): started
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): finished with status 'done'
  Created wheel for apache-beam: filename=apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl size=15396367 sha256=0d36efc63dc37c6f272e34348ccfacbcd3db43327f3afa0bb3b54cce7536d3ca
  Stored in directory: /tmp/pip-ephem-wheel-cache-3fsktbr8/wheels/d4/3a/c0/4dc152b1840724d5b992a8268bb4ef33fdbe42ffe1429b845c
Successfully built apache-beam
    + /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob; json.dump(glob.glob('"'"'/tmp/cibuildwheel/built_wheel/*.whl'"'"'), sys.stdout)'
    + rm -rf /tmp/cibuildwheel/repaired_wheel
    + mkdir -p /tmp/cibuildwheel/repaired_wheel

                                                                     ✓ 241.25s
Repairing wheel...

    + sh -c 'auditwheel repair -w /tmp/cibuildwheel/repaired_wheel /tmp/cibuildwheel/built_wheel/apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl'
INFO:auditwheel.main_repair:Repairing apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl
INFO:auditwheel.wheeltools:Previous filename tags: linux_x86_64
INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_x86_64, manylinux2014_x86_64
INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp38-cp38-linux_x86_64
INFO:auditwheel.wheeltools:New WHEEL info tags: cp38-cp38-manylinux_2_17_x86_64, cp38-cp38-manylinux2014_x86_64
INFO:auditwheel.main_repair:
Fixed-up wheel written to /tmp/cibuildwheel/repaired_wheel/apache_beam-2.52.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
    + /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob; json.dump(glob.glob('"'"'/tmp/cibuildwheel/repaired_wheel/*.whl'"'"'), sys.stdout)'
    + mkdir -p /output
    + mv /tmp/cibuildwheel/repaired_wheel/apache_beam-2.52.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl /output

                                                                       ✓ 6.05s

✓ cp38-manylinux_x86_64 finished in 247.55s
Copying wheels back to host...


                                                                       ✓ 0.13s

1 wheels produced in 4 minutes:
  apache_beam-2.52.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl   15,052 kB

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 9m 40s
117 actionable tasks: 82 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/prh2vs267a6ro

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_Xlang_Gcp_Dataflow #808

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Dataflow/808/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org