You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/10/08 04:12:19 UTC
Build failed in Jenkins: beam_PostCommit_XVR_JavaUsingPython_Dataflow #2470
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/2470/display/redirect>
Changes:
------------------------------------------
[...truncated 1.28 MB...]
#9 321.9 google-cloud-resource-manager==1.10.4
#9 321.9 google-cloud-spanner==3.40.1
#9 321.9 google-cloud-storage==2.11.0
#9 321.9 google-cloud-videointelligence==2.11.4
#9 321.9 google-cloud-vision==3.4.4
#9 321.9 google-crc32c==1.5.0
#9 321.9 google-resumable-media==2.6.0
#9 321.9 googleapis-common-protos==1.60.0
#9 321.9 greenlet==2.0.2
#9 321.9 grpc-google-iam-v1==0.12.6
#9 321.9 grpcio==1.58.0
#9 321.9 grpcio-status==1.58.0
#9 321.9 guppy3==3.1.3
#9 321.9 hdfs==2.7.2
#9 321.9 httplib2==0.22.0
#9 321.9 hypothesis==6.87.0
#9 321.9 idna==3.4
#9 321.9 iniconfig==2.0.0
#9 321.9 joblib==1.3.2
#9 321.9 Js2Py==0.74
#9 321.9 mmh3==4.0.1
#9 321.9 mock==5.1.0
#9 321.9 nltk==3.8.1
#9 321.9 nose==1.3.7
#9 321.9 numpy==1.24.4
#9 321.9 oauth2client==4.1.3
#9 321.9 objsize==0.6.1
#9 321.9 orjson==3.9.7
#9 321.9 overrides==6.5.0
#9 321.9 packaging==23.1
#9 321.9 pandas==1.5.3
#9 321.9 parameterized==0.9.0
#9 321.9 pip==23.2.1
#9 321.9 pluggy==1.3.0
#9 321.9 proto-plus==1.22.3
#9 321.9 protobuf==4.24.3
#9 321.9 psycopg2-binary==2.9.7
#9 321.9 pyarrow==11.0.0
#9 321.9 pyasn1==0.5.0
#9 321.9 pyasn1-modules==0.3.0
#9 321.9 pycparser==2.21
#9 321.9 pydot==1.4.2
#9 321.9 PyHamcrest==2.0.4
#9 321.9 pyjsparser==2.7.1
#9 321.9 pymongo==4.5.0
#9 321.9 PyMySQL==1.1.0
#9 321.9 pyparsing==3.1.1
#9 321.9 pytest==7.4.2
#9 321.9 pytest-timeout==2.1.0
#9 321.9 pytest-xdist==3.3.1
#9 321.9 python-dateutil==2.8.2
#9 321.9 pytz==2023.3.post1
#9 321.9 PyYAML==6.0.1
#9 321.9 regex==2023.8.8
#9 321.9 requests==2.31.0
#9 321.9 requests-mock==1.11.0
#9 321.9 rsa==4.9
#9 321.9 scikit-learn==1.3.1
#9 321.9 scipy==1.11.2
#9 321.9 setuptools==68.2.2
#9 321.9 Shapely==1.8.5.post1
#9 321.9 six==1.16.0
#9 321.9 sortedcontainers==2.4.0
#9 321.9 soupsieve==2.5
#9 321.9 SQLAlchemy==1.4.49
#9 321.9 sqlparse==0.4.4
#9 321.9 tenacity==8.2.3
#9 321.9 testcontainers==3.7.1
#9 321.9 threadpoolctl==3.2.0
#9 321.9 tqdm==4.66.1
#9 321.9 typing_extensions==4.8.0
#9 321.9 tzlocal==5.0.1
#9 321.9 urllib3==1.26.16
#9 321.9 websocket-client==1.6.3
#9 321.9 wheel==0.41.2
#9 321.9 wrapt==1.15.0
#9 321.9 zstandard==0.21.0
#9 DONE 323.2s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.018 Collecting pip-licenses<5
#13 1.019 Obtaining dependency information for pip-licenses<5 from https://files.pythonhosted.org/packages/90/73/d5260c7bd4bfa8d32972e1a8fdec957b999b0a6a8736913fcd8f8d254d25/pip_licenses-4.3.3-py3-none-any.whl.metadata
#13 1.080 Downloading pip_licenses-4.3.3-py3-none-any.whl.metadata (31 kB)
#13 1.096 Requirement already satisfied: pyyaml in /usr/local/lib/python3.11/site-packages (6.0.1)
#13 1.097 Requirement already satisfied: tenacity in /usr/local/lib/python3.11/site-packages (8.2.3)
#13 1.143 Collecting prettytable>=2.3.0 (from pip-licenses<5)
#13 1.144 Obtaining dependency information for prettytable>=2.3.0 from https://files.pythonhosted.org/packages/4d/81/316b6a55a0d1f327d04cc7b0ba9d04058cb62de6c3a4d4b0df280cbe3b0b/prettytable-3.9.0-py3-none-any.whl.metadata
#13 1.159 Downloading prettytable-3.9.0-py3-none-any.whl.metadata (26 kB)
#13 1.209 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5)
#13 1.210 Obtaining dependency information for wcwidth from https://files.pythonhosted.org/packages/58/19/a9ce39f89cf58cf1e7ce01c8bb76ab7e2c7aadbc5a2136c3e192097344f5/wcwidth-0.2.8-py2.py3-none-any.whl.metadata
#13 1.223 Downloading wcwidth-0.2.8-py2.py3-none-any.whl.metadata (13 kB)
#13 1.248 Downloading pip_licenses-4.3.3-py3-none-any.whl (20 kB)
#13 1.279 Downloading prettytable-3.9.0-py3-none-any.whl (27 kB)
#13 1.296 Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
#13 2.440 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.563 Successfully installed pip-licenses-4.3.3 prettytable-3.9.0 wcwidth-0.2.8
#13 2.563 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 13.45 INFO:root:Successfully pulled licenses for 111 dependencies
#13 13.45 Skip pulling license for bs4
#13 DONE 13.5s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.3s
#16 exporting to image
#16 exporting layers
#16 exporting layers 13.1s done
#16 writing image sha256:906a2c8722c6aa1fdf464530659d0cf865f4f9da9f25360493d3a0f1eab9bf12 done
#16 naming to docker.io/apache/beam_python3.11_sdk:2.52.0.dev done
#16 DONE 13.1s
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
b02df18b8220: Preparing
c4133ce14acc: Preparing
f8a39804c92f: Preparing
8df5bdb438ae: Preparing
5bf3f429a5c8: Preparing
19fddc3d9b14: Preparing
4150bc52c071: Preparing
7e74799b7d41: Preparing
c8a297463a78: Preparing
6db4cf9c31a6: Preparing
172b32107611: Preparing
b237bc5a2ac8: Preparing
dcbfd799de9c: Preparing
8a5350ad66cb: Preparing
6db4cf9c31a6: Waiting
19fddc3d9b14: Waiting
172b32107611: Waiting
4150bc52c071: Waiting
b237bc5a2ac8: Waiting
c8a297463a78: Waiting
7e74799b7d41: Waiting
8a5350ad66cb: Waiting
c4133ce14acc: Pushed
5bf3f429a5c8: Pushed
4150bc52c071: Layer already exists
7e74799b7d41: Layer already exists
c8a297463a78: Layer already exists
b02df18b8220: Pushed
6db4cf9c31a6: Layer already exists
172b32107611: Layer already exists
b237bc5a2ac8: Layer already exists
dcbfd799de9c: Layer already exists
8a5350ad66cb: Layer already exists
8df5bdb438ae: Pushed
19fddc3d9b14: Pushed
f8a39804c92f: Pushed
20231008034131: digest: sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1 size: 3267
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 36551
Launching Python expansion service @ 43155
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 35039
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0rc1-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmprbb3rdt2/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 38331
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonFlatMap FAILED
java.lang.RuntimeException at PythonMapTest.java:54
Caused by: java.io.IOException at PythonMapTest.java:54
java.lang.NullPointerException at Preconditions.java:1010
16 tests completed, 1 failed
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231008034131
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231008034131]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231008034131] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231008034131
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04d6760f8d97da951b1bfb3380dff346ccbe631936a3446eef4dcab8ab4b0f53
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231008034131]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04d6760f8d97da951b1bfb3380dff346ccbe631936a3446eef4dcab8ab4b0f53]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231008034131] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04d6760f8d97da951b1bfb3380dff346ccbe631936a3446eef4dcab8ab4b0f53])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04d6760f8d97da951b1bfb3380dff346ccbe631936a3446eef4dcab8ab4b0f53
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 518506.
Stopping expansion service pid: 518507.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 31m
180 actionable tasks: 25 executed, 155 up-to-date
Publishing build scan...
https://ge.apache.org/s/psrwstbmqzjni
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_JavaUsingPython_Dataflow #2471
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/2471/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org