You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/07/17 16:27:54 UTC
Build failed in Jenkins: beam_PreCommit_Python_Integration_Cron #775
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/775/display/redirect?page=changes>
Changes:
[noreply] Update Beam website to release 2.49.0 (#27374)
------------------------------------------
[...truncated 124.51 KB...]
[notice] A new release of pip available: 22.2.2 -> 23.2
[notice] To update, run: pip install --upgrade pip
Processing /project
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'error'
✕ 16.45s
Checking for common errors...
Error: Command ['python', '-m', 'pip', 'wheel', PurePosixPath('/project'), '--wheel-dir=/tmp/cibuildwheel/built_wheel', '--no-deps'] failed with code 1.
> Task :sdks:python:bdistPy311linux FAILED
> Task :sdks:python:test-suites:dataflow:py311:installGcpTest
Successfully installed PyJWT-2.7.0 anyio-3.7.1 apache-beam-2.50.0.dev0 attrs-23.1.0 azure-core-1.28.0 azure-identity-1.14.0b2 azure-storage-blob-12.17.0 boto3-1.28.3 botocore-1.31.3 certifi-2023.5.7 cffi-1.15.1 charset-normalizer-3.2.0 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.2 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.0 docker-6.1.3 docopt-0.6.2 execnet-2.0.2 fastavro-1.8.0 fasteners-0.18 freezegun-1.2.2 google-api-core-2.12.0.dev0 google-apitools-0.5.31 google-auth-2.22.0 google-auth-httplib2-0.1.0 google-cloud-aiplatform-1.28.0 google-cloud-bigquery-3.11.3 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.19.0 google-cloud-core-2.3.3 google-cloud-datastore-2.16.1 google-cloud-dlp-3.12.2 google-cloud-language-2.10.1 google-cloud-pubsub-2.18.0 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.4 google-cloud-resource-manager-1.10.2 google-cloud-spanner-3.36.0 google-cloud-storage-2.10.0 google-cloud-videointelligence-2.11.3 google-cloud-vision-3.4.4 google-crc32c-1.5.0 google-resumable-media-2.5.0 googleapis-common-protos-1.59.1 greenlet-3.0.0a1 grpc-google-iam-v1-0.12.6 grpcio-status-1.56.0 h11-0.14.0 hdfs-2.7.0 httpcore-0.17.3 httplib2-0.22.0 hypothesis-6.81.2 idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.1 mock-5.1.0 msal-1.22.0 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.2 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 portalocker-2.7.0 proto-plus-1.22.3 protobuf-4.23.4 psycopg2-binary-2.9.6 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.0.4 pymongo-4.4.1 pymysql-1.1.0 pyparsing-3.1.0 pytest-7.4.0 pytest-timeout-2.1.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3 pyyaml-6.0 regex-2023.6.3 requests-2.31.0 requests_mock-1.11.0 rsa-4.9 s3transfer-0.6.1 scikit-learn-1.3.0 scipy-1.11.1 shapely-1.8.5.post1 six-1.16.0 sniffio-1.3.0 sortedcontainers-2.4.0 sqlalchemy-1.4.49 sqlparse-0.4.4 tenacity-8.2.2 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.7.1 urllib3-1.26.16 websocket-client-1.6.1 wrapt-1.15.0 zstandard-0.21.0
> Task :sdks:python:bdistPy38linux
Requirement already satisfied: cibuildwheel==2.9.0 in <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (2.9.0)
Requirement already satisfied: bashlex!=0.13 in <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (0.18)
Requirement already satisfied: bracex in <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (2.3.post1)
Requirement already satisfied: certifi in <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (2023.5.7)
Requirement already satisfied: filelock in <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (3.12.2)
Requirement already satisfied: packaging>=20.9 in <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (23.1)
Requirement already satisfied: platformdirs in <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (3.9.1)
Requirement already satisfied: tomli in <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from cibuildwheel==2.9.0) (2.0.1)
cp38-manylinux_x86_64
_ _ _ _ _ _ _
___|_| |_ _ _|_| |_| |_ _ _| |_ ___ ___| |
| _| | . | | | | | . | | | | | -_| -_| |
|___|_|___|___|_|_|___|_____|_|_|___|___|_|
cibuildwheel version 2.9.0
Build options:
platform: 'linux'
architectures: {<Architecture.x86_64: 'x86_64'>, <Architecture.i686: 'i686'>}
build_selector: {'build_config': 'cp38-manylinux_*64*', 'skip_config': '', 'requires_python': None, 'prerelease_pythons': False}
container_engine: 'docker'
output_dir: PosixPath('<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/build')>
package_dir: PosixPath('<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python')>
test_selector: {'skip_config': ''}
before_all: ''
before_build: 'pip install cython numpy && pip install --upgrade setuptools'
before_test: ''
build_frontend: 'pip'
build_verbosity: 0
dependency_constraints: DependencyConstraints(PosixPath('<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/cibuildwheel/resources/constraints.txt'))>
environment: {'assignments': [SETUPTOOLS_USE_DISTUTILS=stdlib]}
cp38-manylinux_x86_64: ParsedEnvironment(['SETUPTOOLS_USE_DISTUTILS=stdlib'])
manylinux_images: {'x86_64': 'quay.io/pypa/manylinux2014_x86_64:2022-08-09-51a01be', 'i686': 'quay.io/pypa/manylinux2014_i686:2022-08-09-51a01be', 'pypy_x86_64': 'quay.io/pypa/manylinux2014_x86_64:2022-08-09-51a01be', 'aarch64': 'quay.io/pypa/manylinux2014_aarch64:2022-08-09-51a01be', 'ppc64le': 'quay.io/pypa/manylinux2014_ppc64le:2022-08-09-51a01be', 's390x': 'quay.io/pypa/manylinux2014_s390x:2022-08-09-51a01be', 'pypy_aarch64': 'quay.io/pypa/manylinux2014_aarch64:2022-08-09-51a01be', 'pypy_i686': 'quay.io/pypa/manylinux2014_i686:2022-08-09-51a01be'}
musllinux_images: {'x86_64': 'quay.io/pypa/musllinux_1_1_x86_64:2022-08-09-51a01be', 'i686': 'quay.io/pypa/musllinux_1_1_i686:2022-08-09-51a01be', 'aarch64': 'quay.io/pypa/musllinux_1_1_aarch64:2022-08-09-51a01be', 'ppc64le': 'quay.io/pypa/musllinux_1_1_ppc64le:2022-08-09-51a01be', 's390x': 'quay.io/pypa/musllinux_1_1_s390x:2022-08-09-51a01be'}
repair_command: 'auditwheel repair -w {dest_dir} {wheel}'
test_command: ''
test_extras: ''
test_requires: []
Cache folder: /home/jenkins/.cache/cibuildwheel
Here we go!
Starting container image quay.io/pypa/manylinux2014_x86_64:2022-08-09-51a01be...
info: This container will host the build for cp38-manylinux_x86_64...
d8e60098fe51d4f5f2ccd83df0f6bc23580cbde481e0154426677060d65ea62a
+ /bin/true
+ mkdir -p /project
✓ 0.52s
Copying project into container...
+ mkdir -p /project
✓ 0.25s
Building cp38-manylinux_x86_64 wheel
CPython 3.8 manylinux x86_64
Setting up build environment...
+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, os; json.dump(os.environ.copy(), sys.stdout)'
+ which python
+ which pip
✓ 0.13s
Running before_build...
+ sh -c 'pip install cython numpy && pip install --upgrade setuptools'
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip available: 22.2.2 -> 23.2
[notice] To update, run: python -m pip install --upgrade pip
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip available: 22.2.2 -> 23.2
[notice] To update, run: python -m pip install --upgrade pip
Collecting cython
Downloading Cython-3.0.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.6/3.6 MB 34.4 MB/s eta 0:00:00
Collecting numpy
Downloading numpy-1.24.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 56.1 MB/s eta 0:00:00
Installing collected packages: numpy, cython
Successfully installed cython-3.0.0 numpy-1.24.4
Requirement already satisfied: setuptools in /opt/_internal/cpython-3.8.13/lib/python3.8/site-packages (63.4.2)
Collecting setuptools
Downloading setuptools-68.0.0-py3-none-any.whl (804 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 804.0/804.0 kB 13.4 MB/s eta 0:00:00
Installing collected packages: setuptools
Attempting uninstall: setuptools
Found existing installation: setuptools 63.4.2
Uninstalling setuptools-63.4.2:
Successfully uninstalled setuptools-63.4.2
Successfully installed setuptools-68.0.0
✓ 10.27s
Building wheel...
+ rm -rf /tmp/cibuildwheel/built_wheel
+ mkdir -p /tmp/cibuildwheel/built_wheel
+ python -m pip wheel /project --wheel-dir=/tmp/cibuildwheel/built_wheel --no-deps
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [54 lines of output]
/project/setup.py:28: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
from pkg_resources import DistributionNotFound
warning: apache_beam/runners/common.py:1429:17: Unknown type declaration 'BaseException' in annotation, ignoring
Error compiling Cython file:
------------------------------------------------------------
...
return progress.with_completed(
self.tagged_receivers.total_output_bytes() -
self.element_start_output_bytes)
return None
def monitoring_infos(self, transform_id, tag_to_pcollection_id):
^
------------------------------------------------------------
apache_beam/runners/worker/operations.py:1106:2: closures inside cpdef functions not yet supported
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "/project/setup.py", line 215, in <module>
ext_modules=cythonize([
File "/project/setup.py", line 133, in cythonize
extensions = cythonize0(*args, **kwargs)
File "/opt/python/cp38-cp38/lib/python3.8/site-packages/Cython/Build/Dependencies.py", line 1134, in cythonize
cythonize_one(*args)
File "/opt/python/cp38-cp38/lib/python3.8/site-packages/Cython/Build/Dependencies.py", line 1301, in cythonize_one
raise CompileError(None, pyx_file)
Cython.Compiler.Errors.CompileError: apache_beam/runners/worker/operations.py
Compiling apache_beam/coders/coder_impl_row_encoders.pyx because it changed.
Compiling apache_beam/coders/stream.pyx because it changed.
Compiling apache_beam/runners/worker/statesampler_fast.pyx because it changed.
Compiling apache_beam/testing/fast_test_utils.pyx because it changed.
Compiling apache_beam/transforms/cy_dataflow_distribution_counter.pyx because it changed.
Compiling apache_beam/coders/coder_impl.py because it changed.
Compiling apache_beam/metrics/cells.py because it changed.
Compiling apache_beam/metrics/execution.py because it changed.
Compiling apache_beam/runners/common.py because it changed.
Compiling apache_beam/runners/worker/logger.py because it changed.
Compiling apache_beam/runners/worker/opcounters.py because it changed.
Compiling apache_beam/runners/worker/operations.py because it changed.
Compiling apache_beam/transforms/cy_combiners.py because it changed.
Compiling apache_beam/transforms/stats.py because it changed.
Compiling apache_beam/utils/counters.py because it changed.
Compiling apache_beam/utils/windowed_value.py because it changed.
[ 1/16] Cythonizing apache_beam/coders/coder_impl.py
[ 2/16] Cythonizing apache_beam/coders/coder_impl_row_encoders.pyx
[ 3/16] Cythonizing apache_beam/coders/stream.pyx
[ 4/16] Cythonizing apache_beam/metrics/cells.py
[ 5/16] Cythonizing apache_beam/metrics/execution.py
[ 6/16] Cythonizing apache_beam/runners/common.py
[ 7/16] Cythonizing apache_beam/runners/worker/logger.py
[ 8/16] Cythonizing apache_beam/runners/worker/opcounters.py
[ 9/16] Cythonizing apache_beam/runners/worker/operations.py
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
[notice] A new release of pip available: 22.2.2 -> 23.2
[notice] To update, run: pip install --upgrade pip
Processing /project
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'error'
✕ 14.68s
Checking for common errors...
Error: Command ['python', '-m', 'pip', 'wheel', PurePosixPath('/project'), '--wheel-dir=/tmp/cibuildwheel/built_wheel', '--no-deps'] failed with code 1.
> Task :sdks:python:bdistPy38linux FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/build.gradle'> line: 96
* What went wrong:
Execution failed for task ':sdks:python:bdistPy311linux'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/build.gradle'> line: 96
* What went wrong:
Execution failed for task ':sdks:python:bdistPy38linux'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 23s
18 actionable tasks: 12 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://ge.apache.org/s/6a5vlkwrwotvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PreCommit_Python_Integration_Cron #776
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/776/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org