You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/11/02 17:38:58 UTC
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1111
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1111/display/redirect?page=changes>
Changes:
[bulat.safiullin] [Website] add shuffle to logos
[Moritz Mack] Fix Spark 3 job-server jar path for Python test suites (closes #23935,
[noreply] Bump actions/setup-java from 3.5.1 to 3.6.0 (#23797)
[noreply] [CdapIO] Add integration tests for SparkReceiverIO (#23305)
------------------------------------------
[...truncated 1.01 MB...]
overrides==6.5.0
packaging==21.3
pandas==1.4.4
parameterized==0.8.1
pbr==5.11.0
pip==22.3
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.4
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.1.3
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.5
PyYAML==6.0
regex==2022.9.13
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.2
scipy==1.9.3
setuptools==65.5.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.42
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.10.0
tensorflow-estimator==2.10.0
tensorflow-io-gcs-filesystem==0.27.0
termcolor==2.0.1
testcontainers==3.7.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
websocket-client==1.4.1
Werkzeug==2.2.2
wheel==0.37.1
wrapt==1.14.1
zstandard==0.18.0
Removing intermediate container 99235c245636
---> 2aefbd9109cb
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 1842333a6d94
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> 6ac87b2ba1c0
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> 56e2e4b09b08
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 77c4485b904e
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in fc99e4e5eea9
Removing intermediate container fc99e4e5eea9
---> 229a4201cc85
Step 22/32 : FROM beam as third_party_licenses
---> 229a4201cc85
Step 23/32 : ARG pull_licenses
---> Running in 24bf0b236423
Removing intermediate container 24bf0b236423
---> 9a0511995e5f
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> 31fe7e305918
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 14972689c791
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 4e61fda031b7
Removing intermediate container 4e61fda031b7
---> 2ac710c55a0a
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> d44b2e26e5e1
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 8cf508bad8ea
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=16e1e99e87386e2fcdfd9894bc089007886ff8fbe5470376eebeb6ba96347e1a
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mSkip pulling license for bs4
Removing intermediate container 8cf508bad8ea
---> ed9056b6db36
Step 29/32 : FROM beam
---> 229a4201cc85
Step 30/32 : ARG pull_licenses
---> Running in 45604a37ebd3
Removing intermediate container 45604a37ebd3
---> a29dc9332d22
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> b65ecd25c263
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 9315b0c75df7
Removing intermediate container 9315b0c75df7
---> 00908a962cc2
Successfully built 00908a962cc2
Successfully tagged apache/beam_python3.10_sdk:2.44.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
5e780790b3a0: Preparing
cc38f12b3c7e: Preparing
480da3f00b7b: Preparing
49e8e97a4499: Preparing
d7806c6b6365: Preparing
a02d84bc8453: Preparing
55ff800cf5fe: Preparing
ede9171a6674: Preparing
67594f72ced7: Preparing
1b3cb4ba40c2: Preparing
82bd0a754979: Preparing
4099e7288bdb: Preparing
93a7606f3951: Preparing
9be3c99e1c1a: Preparing
f5d161bba139: Preparing
1569e0d95ce6: Preparing
d9e08da15d0c: Preparing
6b183c62e3d7: Preparing
882fd36bfd35: Preparing
d1dec9917839: Preparing
d38adf39e1dd: Preparing
4ed121b04368: Preparing
d9d07d703dd5: Preparing
f5d161bba139: Waiting
a02d84bc8453: Waiting
1569e0d95ce6: Waiting
55ff800cf5fe: Waiting
d9e08da15d0c: Waiting
ede9171a6674: Waiting
d38adf39e1dd: Waiting
4ed121b04368: Waiting
93a7606f3951: Waiting
6b183c62e3d7: Waiting
d1dec9917839: Waiting
67594f72ced7: Waiting
882fd36bfd35: Waiting
4099e7288bdb: Waiting
1b3cb4ba40c2: Waiting
9be3c99e1c1a: Waiting
82bd0a754979: Waiting
480da3f00b7b: Pushed
d7806c6b6365: Pushed
5e780790b3a0: Pushed
49e8e97a4499: Pushed
ede9171a6674: Pushed
55ff800cf5fe: Pushed
cc38f12b3c7e: Pushed
67594f72ced7: Pushed
93a7606f3951: Pushed
9be3c99e1c1a: Pushed
f5d161bba139: Layer already exists
1569e0d95ce6: Layer already exists
82bd0a754979: Pushed
d9e08da15d0c: Layer already exists
882fd36bfd35: Layer already exists
6b183c62e3d7: Layer already exists
d1dec9917839: Layer already exists
d38adf39e1dd: Layer already exists
4ed121b04368: Layer already exists
d9d07d703dd5: Layer already exists
a02d84bc8453: Pushed
1b3cb4ba40c2: Pushed
4099e7288bdb: Pushed
name unknown: Failed to get blob sizes.
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 44779
Launching Python expansion service @ 34389
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 683648.
Stopping expansion service pid: 683649.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 330
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 13m 58s
126 actionable tasks: 22 executed, 104 up-to-date
Publishing build scan...
https://gradle.com/s/sw5lxal5gsto2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_PythonUsingJava_Dataflow #1113
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1113/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1112
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1112/display/redirect?page=changes>
Changes:
[noreply] [Go] Ensure iterated and emitted types are registered. (#23890)
[chamikaramj] Updates Multi-language Java examples documentation
[noreply] [Python SDK] Re-enable PipelineOptionsTest.test_display_data (#23787)
[noreply] Unify PerformanceTest metric dashboard naming and series (#23914)
------------------------------------------
[...truncated 1007.48 KB...]
packaging==21.3
pandas==1.4.4
parameterized==0.8.1
pbr==5.11.0
pip==22.3
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.4
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.1.3
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.5
PyYAML==6.0
regex==2022.9.13
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.2
scipy==1.9.3
setuptools==65.5.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.42
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.10.0
tensorflow-estimator==2.10.0
tensorflow-io-gcs-filesystem==0.27.0
termcolor==2.0.1
testcontainers==3.7.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
websocket-client==1.4.1
Werkzeug==2.2.2
wheel==0.37.1
wrapt==1.14.1
zstandard==0.18.0
Removing intermediate container 58f201e543db
---> 602bfb56d51c
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 946de0ca4fde
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> c4b3cb3c7da4
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> c776e9695342
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 53a567177f86
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 0ebac20cc605
Removing intermediate container 0ebac20cc605
---> 2b1ffb1791c8
Step 22/32 : FROM beam as third_party_licenses
---> 2b1ffb1791c8
Step 23/32 : ARG pull_licenses
---> Running in 68043c6cd77b
Removing intermediate container 68043c6cd77b
---> efb7e5b31ee4
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> 67c0493d15ef
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> a3eff00f62a1
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 51a4c1468c1f
Removing intermediate container 51a4c1468c1f
---> 35f8a32df6f2
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 004f7d5fbc09
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 89def86d7fbe
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=0fbd4035776dc1f423d4d2632c31b8668b861b8b6ca0f2c622af5956e1f1697c
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mRemoving intermediate container 89def86d7fbe
---> 6e8df2e995c9
Step 29/32 : FROM beam
---> 2b1ffb1791c8
Step 30/32 : ARG pull_licenses
---> Running in fc0e02706bb2
Removing intermediate container fc0e02706bb2
---> a89233507c0a
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> f3c955a06eaa
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 02ecc10eff44
Removing intermediate container 02ecc10eff44
---> b14edc877847
Successfully built b14edc877847
Successfully tagged apache/beam_python3.10_sdk:2.44.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
3e3d57e79de0: Preparing
21075747e87f: Preparing
5c9b171a9686: Preparing
83b1fae24755: Preparing
f17786fc9f16: Preparing
63ba6f8c1e21: Preparing
53ec788c841d: Preparing
735f1fa0c3be: Preparing
e3688ed2fd4e: Preparing
52836c0e1242: Preparing
b1e9ef898161: Preparing
50aae233e979: Preparing
7ace4a86db08: Preparing
34d64d835382: Preparing
f5d161bba139: Preparing
1569e0d95ce6: Preparing
d9e08da15d0c: Preparing
6b183c62e3d7: Preparing
882fd36bfd35: Preparing
d1dec9917839: Preparing
d38adf39e1dd: Preparing
4ed121b04368: Preparing
d9d07d703dd5: Preparing
52836c0e1242: Waiting
53ec788c841d: Waiting
735f1fa0c3be: Waiting
e3688ed2fd4e: Waiting
b1e9ef898161: Waiting
34d64d835382: Waiting
1569e0d95ce6: Waiting
50aae233e979: Waiting
6b183c62e3d7: Waiting
f5d161bba139: Waiting
7ace4a86db08: Waiting
d9e08da15d0c: Waiting
d9d07d703dd5: Waiting
63ba6f8c1e21: Waiting
d38adf39e1dd: Waiting
4ed121b04368: Waiting
d1dec9917839: Waiting
882fd36bfd35: Waiting
f17786fc9f16: Pushed
5c9b171a9686: Pushed
83b1fae24755: Pushed
3e3d57e79de0: Pushed
e3688ed2fd4e: Pushed
21075747e87f: Pushed
735f1fa0c3be: Pushed
53ec788c841d: Pushed
7ace4a86db08: Pushed
34d64d835382: Pushed
f5d161bba139: Layer already exists
1569e0d95ce6: Layer already exists
d9e08da15d0c: Layer already exists
6b183c62e3d7: Layer already exists
882fd36bfd35: Layer already exists
d1dec9917839: Layer already exists
d38adf39e1dd: Layer already exists
4ed121b04368: Layer already exists
d9d07d703dd5: Layer already exists
b1e9ef898161: Pushed
63ba6f8c1e21: Pushed
52836c0e1242: Pushed
50aae233e979: Pushed
name unknown: Failed to get blob sizes.
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 35177
Launching Python expansion service @ 43797
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 956745.
Stopping expansion service pid: 956746.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 330
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 24s
126 actionable tasks: 22 executed, 104 up-to-date
Publishing build scan...
https://gradle.com/s/iiczdqqetptag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org