You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/11/03 11:34:35 UTC
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1114
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1114/display/redirect>
Changes:
------------------------------------------
[...truncated 1022.51 KB...]
objsize==0.5.2
opt-einsum==3.3.0
orjson==3.8.0
overrides==6.5.0
packaging==21.3
pandas==1.4.4
parameterized==0.8.1
pbr==5.11.0
pip==22.3
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.4
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.1.3
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.5
PyYAML==6.0
regex==2022.9.13
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.2
scipy==1.9.3
setuptools==65.5.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.42
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.10.0
tensorflow-estimator==2.10.0
tensorflow-io-gcs-filesystem==0.27.0
termcolor==2.0.1
testcontainers==3.7.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
websocket-client==1.4.1
Werkzeug==2.2.2
wheel==0.37.1
wrapt==1.14.1
zstandard==0.18.0
Removing intermediate container 71f7883e75e8
---> f8e304004d51
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> ed7dccfd8ff9
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> 2bafdc508b1a
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> 974bf4b18b7f
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 8536299c4524
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in fefdaaf9e3c4
Removing intermediate container fefdaaf9e3c4
---> cd629fbd9034
Step 22/32 : FROM beam as third_party_licenses
---> cd629fbd9034
Step 23/32 : ARG pull_licenses
---> Running in 1f48859aaf5a
Removing intermediate container 1f48859aaf5a
---> 5529f10b1f71
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> 7c3b16ca53ff
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 6cfc391d1053
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 0e8a541bb474
Removing intermediate container 0e8a541bb474
---> f0ce8f6f6d4f
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 23c4d1344919
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 859648b86e13
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=b9949e2c7358301c6b1029961c87bd5ec9e5610573fb4944452bb541a4546d05
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mRemoving intermediate container 859648b86e13
---> b9f58eccd0ca
Step 29/32 : FROM beam
---> cd629fbd9034
Step 30/32 : ARG pull_licenses
---> Running in ec49b60aba09
Removing intermediate container ec49b60aba09
---> f93acacb4196
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> cbda39b4d54c
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in e437eb944890
Removing intermediate container e437eb944890
---> aa20a0327680
Successfully built aa20a0327680
Successfully tagged apache/beam_python3.10_sdk:2.44.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
e077ec97558a: Preparing
a0b12ee85d41: Preparing
fdf930bde2f7: Preparing
ae744b1843d4: Preparing
3899a6633bc9: Preparing
d8e4bb57aff1: Preparing
eafb6e631537: Preparing
d08d8af303af: Preparing
18624fe66619: Preparing
813d15882ef0: Preparing
f5f28dacfd48: Preparing
1c105514c30d: Preparing
7a53d2ca5929: Preparing
a69d5ec4eb84: Preparing
f5d161bba139: Preparing
1569e0d95ce6: Preparing
d9e08da15d0c: Preparing
6b183c62e3d7: Preparing
1c105514c30d: Waiting
7a53d2ca5929: Waiting
f5f28dacfd48: Waiting
1569e0d95ce6: Waiting
f5d161bba139: Waiting
d9e08da15d0c: Waiting
d08d8af303af: Waiting
813d15882ef0: Waiting
eafb6e631537: Waiting
882fd36bfd35: Preparing
d1dec9917839: Preparing
d38adf39e1dd: Preparing
4ed121b04368: Preparing
d38adf39e1dd: Waiting
d9d07d703dd5: Preparing
d1dec9917839: Waiting
6b183c62e3d7: Waiting
882fd36bfd35: Waiting
d9d07d703dd5: Waiting
ae744b1843d4: Pushed
fdf930bde2f7: Pushed
3899a6633bc9: Pushed
e077ec97558a: Pushed
a0b12ee85d41: Pushed
d08d8af303af: Pushed
eafb6e631537: Pushed
18624fe66619: Pushed
7a53d2ca5929: Pushed
a69d5ec4eb84: Pushed
f5d161bba139: Layer already exists
1569e0d95ce6: Layer already exists
d9e08da15d0c: Layer already exists
6b183c62e3d7: Layer already exists
882fd36bfd35: Layer already exists
d1dec9917839: Layer already exists
d38adf39e1dd: Layer already exists
4ed121b04368: Layer already exists
d9d07d703dd5: Layer already exists
f5f28dacfd48: Pushed
d8e4bb57aff1: Pushed
813d15882ef0: Pushed
1c105514c30d: Pushed
name unknown: Failed to get blob sizes.
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 44573
Launching Python expansion service @ 38993
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1354948.
Stopping expansion service pid: 1354949.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 330
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 12s
126 actionable tasks: 22 executed, 104 up-to-date
Publishing build scan...
https://gradle.com/s/oaoriwqffnf2e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_PythonUsingJava_Dataflow #1118
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1118/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1117
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1117/display/redirect?page=changes>
Changes:
[noreply] Disable flaky fn_api_runner tests (#23971)
[noreply] Make BatchConverter inference errors more helpful (#23965)
------------------------------------------
[...truncated 1010.03 KB...]
orjson==3.8.0
overrides==6.5.0
packaging==21.3
pandas==1.4.4
parameterized==0.8.1
pbr==5.11.0
pip==22.3
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.4
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.1.3
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.5
PyYAML==6.0
regex==2022.9.13
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.2
scipy==1.9.3
setuptools==65.5.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.42
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.10.0
tensorflow-estimator==2.10.0
tensorflow-io-gcs-filesystem==0.27.0
termcolor==2.0.1
testcontainers==3.7.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
websocket-client==1.4.1
Werkzeug==2.2.2
wheel==0.37.1
wrapt==1.14.1
zstandard==0.18.0
Removing intermediate container f72e376ebc83
---> 4fbe9c1b8631
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> cde110281156
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> 647173b9c6e9
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> f54899fb024c
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 16337aae686b
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 25cf29b0cdc8
Removing intermediate container 25cf29b0cdc8
---> 6356e55e5628
Step 22/32 : FROM beam as third_party_licenses
---> 6356e55e5628
Step 23/32 : ARG pull_licenses
---> Running in e84a007c8bec
Removing intermediate container e84a007c8bec
---> e417d0b20814
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> f1435a28cb41
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 3fd777b1932f
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 9e97f8a102a5
Removing intermediate container 9e97f8a102a5
---> 26b45accf9fd
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 0230d26224b6
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 03aab715367b
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=344fe47bd8a6be0d0d217799e59def1a4fad1cc023db2302adeb3a31b69abe47
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mSkip pulling license for bs4
Removing intermediate container 03aab715367b
---> 5cf648d394bd
Step 29/32 : FROM beam
---> 6356e55e5628
Step 30/32 : ARG pull_licenses
---> Running in 83820bd7b245
Removing intermediate container 83820bd7b245
---> ede0ee3a3913
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 011d42cab299
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 78a406d339aa
Removing intermediate container 78a406d339aa
---> 304ed4577163
Successfully built 304ed4577163
Successfully tagged apache/beam_python3.10_sdk:2.44.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
12c520e30fbc: Preparing
beb2f2423c58: Preparing
31edb9c6ad67: Preparing
17ebb1479a8f: Preparing
463e7eb297c1: Preparing
abbecbe3cc94: Preparing
0b274f2a32a9: Preparing
b2a221f06ca2: Preparing
f472511c86fe: Preparing
d619fd38c6d9: Preparing
c15765fb5f0f: Preparing
eda7b1d6665a: Preparing
51bd9a8e82d2: Preparing
0b8b85570f91: Preparing
f5d161bba139: Preparing
1569e0d95ce6: Preparing
d9e08da15d0c: Preparing
6b183c62e3d7: Preparing
882fd36bfd35: Preparing
abbecbe3cc94: Waiting
d1dec9917839: Preparing
d38adf39e1dd: Preparing
4ed121b04368: Preparing
d9d07d703dd5: Preparing
0b274f2a32a9: Waiting
51bd9a8e82d2: Waiting
d619fd38c6d9: Waiting
b2a221f06ca2: Waiting
c15765fb5f0f: Waiting
f472511c86fe: Waiting
882fd36bfd35: Waiting
eda7b1d6665a: Waiting
d9e08da15d0c: Waiting
4ed121b04368: Waiting
d1dec9917839: Waiting
0b8b85570f91: Waiting
1569e0d95ce6: Waiting
d38adf39e1dd: Waiting
d9d07d703dd5: Waiting
17ebb1479a8f: Pushed
463e7eb297c1: Pushed
12c520e30fbc: Pushed
31edb9c6ad67: Pushed
beb2f2423c58: Pushed
b2a221f06ca2: Pushed
0b274f2a32a9: Pushed
f472511c86fe: Pushed
51bd9a8e82d2: Pushed
0b8b85570f91: Pushed
f5d161bba139: Layer already exists
1569e0d95ce6: Layer already exists
d9e08da15d0c: Layer already exists
6b183c62e3d7: Layer already exists
882fd36bfd35: Layer already exists
d1dec9917839: Layer already exists
d38adf39e1dd: Layer already exists
4ed121b04368: Layer already exists
d9d07d703dd5: Layer already exists
c15765fb5f0f: Pushed
abbecbe3cc94: Pushed
d619fd38c6d9: Pushed
eda7b1d6665a: Pushed
name unknown: Failed to get blob sizes.
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 40251
Launching Python expansion service @ 32791
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2674419.
Stopping expansion service pid: 2674420.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 330
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 16s
126 actionable tasks: 22 executed, 104 up-to-date
Publishing build scan...
https://gradle.com/s/kbxwjsq4g6t5q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1116
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1116/display/redirect?page=changes>
Changes:
[ahmedabualsaud] emit load job IDs as soon as they come up
[ahmedabualsaud] style fix
[noreply] Initial draft of Batched DoFn user guide (#23909)
[noreply] WIP: Dataframe API ML preprocessing notebook (#22587)
[noreply] [Python] Added none check while accessing active_process_bundle (#23947)
[noreply] [Tour Of Beam] saving user code (#23938)
------------------------------------------
[...truncated 1.02 MB...]
opt-einsum==3.3.0
orjson==3.8.0
overrides==6.5.0
packaging==21.3
pandas==1.4.4
parameterized==0.8.1
pbr==5.11.0
pip==22.3
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.4
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.1.3
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.5
PyYAML==6.0
regex==2022.9.13
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.2
scipy==1.9.3
setuptools==65.5.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.42
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.10.0
tensorflow-estimator==2.10.0
tensorflow-io-gcs-filesystem==0.27.0
termcolor==2.0.1
testcontainers==3.7.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
websocket-client==1.4.1
Werkzeug==2.2.2
wheel==0.37.1
wrapt==1.14.1
zstandard==0.18.0
Removing intermediate container 1d4237ea3481
---> 7b51fee5c372
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> cb5ccaa63d53
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> e4657e3c4243
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> c67dd10ca425
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 1892abdab650
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 61b77d662539
Removing intermediate container 61b77d662539
---> 48db6d27772a
Step 22/32 : FROM beam as third_party_licenses
---> 48db6d27772a
Step 23/32 : ARG pull_licenses
---> Running in 91ed04cc11d7
Removing intermediate container 91ed04cc11d7
---> b58dec244230
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> ed90e1909aa9
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 9468cc4474fb
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 4a764462ee78
Removing intermediate container 4a764462ee78
---> a760bb5897b2
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 9a30186144f1
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 38f812256c97
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=1511548db101808eafaf433220599f74da7ef6a8518cf74e0f6f481ab6728ebc
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mSkip pulling license for bs4
Removing intermediate container 38f812256c97
---> 15823f11b635
Step 29/32 : FROM beam
---> 48db6d27772a
Step 30/32 : ARG pull_licenses
---> Running in 71e00e8bdfb8
Removing intermediate container 71e00e8bdfb8
---> b0ea9ab52c22
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 3c310f385cc9
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in ca295847c6f7
Removing intermediate container ca295847c6f7
---> 624e19d7cc13
Successfully built 624e19d7cc13
Successfully tagged apache/beam_python3.10_sdk:2.44.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
dfbe122cc323: Preparing
01852d2e10f6: Preparing
2b48822de113: Preparing
3a6e2a95e6d4: Preparing
c32a5ce6a2d6: Preparing
7642a2c49954: Preparing
889c160c73ae: Preparing
2847014fd7cb: Preparing
ba0879cce421: Preparing
488f30783b88: Preparing
79f831059377: Preparing
514c18a4bc7b: Preparing
93e1862ec891: Preparing
3f5719348a8f: Preparing
f5d161bba139: Preparing
1569e0d95ce6: Preparing
d9e08da15d0c: Preparing
6b183c62e3d7: Preparing
882fd36bfd35: Preparing
d1dec9917839: Preparing
889c160c73ae: Waiting
d38adf39e1dd: Preparing
4ed121b04368: Preparing
d9d07d703dd5: Preparing
ba0879cce421: Waiting
2847014fd7cb: Waiting
488f30783b88: Waiting
d9e08da15d0c: Waiting
79f831059377: Waiting
7642a2c49954: Waiting
6b183c62e3d7: Waiting
d38adf39e1dd: Waiting
514c18a4bc7b: Waiting
d9d07d703dd5: Waiting
882fd36bfd35: Waiting
f5d161bba139: Waiting
93e1862ec891: Waiting
3f5719348a8f: Waiting
2b48822de113: Pushed
3a6e2a95e6d4: Pushed
dfbe122cc323: Pushed
c32a5ce6a2d6: Pushed
01852d2e10f6: Pushed
ba0879cce421: Pushed
2847014fd7cb: Pushed
889c160c73ae: Pushed
93e1862ec891: Pushed
3f5719348a8f: Pushed
f5d161bba139: Layer already exists
1569e0d95ce6: Layer already exists
d9e08da15d0c: Layer already exists
79f831059377: Pushed
6b183c62e3d7: Layer already exists
d1dec9917839: Layer already exists
882fd36bfd35: Layer already exists
d38adf39e1dd: Layer already exists
4ed121b04368: Layer already exists
d9d07d703dd5: Layer already exists
7642a2c49954: Pushed
488f30783b88: Pushed
514c18a4bc7b: Pushed
name unknown: Failed to get blob sizes.
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 34343
Launching Python expansion service @ 40049
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3034152.
Stopping expansion service pid: 3034153.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 330
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 11m 48s
126 actionable tasks: 22 executed, 104 up-to-date
Publishing build scan...
https://gradle.com/s/wgtba22xpjfzo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1115
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1115/display/redirect?page=changes>
Changes:
[Moritz Mack] [Spark dataset runner] Add direct translation of Combine.GroupedValues
[noreply] Concept guide on orchestrating Beam preprocessing (#23094)
------------------------------------------
[...truncated 582.91 KB...]
packaging==21.3
pandas==1.4.4
parameterized==0.8.1
pbr==5.11.0
pip==22.3
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.4
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.1.3
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.5
PyYAML==6.0
regex==2022.9.13
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.2
scipy==1.9.3
setuptools==65.5.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.42
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.10.0
tensorflow-estimator==2.10.0
tensorflow-io-gcs-filesystem==0.27.0
termcolor==2.0.1
testcontainers==3.7.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
websocket-client==1.4.1
Werkzeug==2.2.2
wheel==0.37.1
wrapt==1.14.1
zstandard==0.18.0
Removing intermediate container 1a6f507c9eaa
---> 7b3c09e494e8
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 9fcdf30e951e
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> de1e7d02fce6
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> a164f02ce97d
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 81a83e955ff4
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in a4f64c8d90c8
Removing intermediate container a4f64c8d90c8
---> a6a32457f5de
Step 22/32 : FROM beam as third_party_licenses
---> a6a32457f5de
Step 23/32 : ARG pull_licenses
---> Running in a033366c9d15
Removing intermediate container a033366c9d15
---> 99ec1cb71f9a
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> f0f7aa80da26
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 5a5dc72eb33a
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 5db57b86c6f7
Removing intermediate container 5db57b86c6f7
---> 6d2558329293
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> bfe32d464cf9
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in a3247685ba67
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=233b11cee32b7a0f4c69dfc7ffad18d991995da92957056ee93c3a6b991d41bb
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mRemoving intermediate container a3247685ba67
---> d7066e1c6f89
Step 29/32 : FROM beam
---> a6a32457f5de
Step 30/32 : ARG pull_licenses
---> Running in 35875cc0966c
Removing intermediate container 35875cc0966c
---> c91c0a0c9402
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 4d4f2488b29a
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 2b92fccc2ed6
Removing intermediate container 2b92fccc2ed6
---> 4338419aa026
Successfully built 4338419aa026
Successfully tagged apache/beam_python3.10_sdk:2.44.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
ade90bb2cf2b: Preparing
e8450b31622d: Preparing
9fb3eaa92a30: Preparing
343c2ebf14a9: Preparing
8ba8e88deaf7: Preparing
4bbd429936f6: Preparing
eed2674f7315: Preparing
0021fcc8e567: Preparing
79e2d5429084: Preparing
e85fbaf969fd: Preparing
5398b6ec2dab: Preparing
6e3179204289: Preparing
e0f4665cf699: Preparing
8b4bb7ee456c: Preparing
f5d161bba139: Preparing
1569e0d95ce6: Preparing
d9e08da15d0c: Preparing
6b183c62e3d7: Preparing
882fd36bfd35: Preparing
d1dec9917839: Preparing
d38adf39e1dd: Preparing
4bbd429936f6: Waiting
4ed121b04368: Preparing
e85fbaf969fd: Waiting
d9d07d703dd5: Preparing
79e2d5429084: Waiting
5398b6ec2dab: Waiting
e0f4665cf699: Waiting
0021fcc8e567: Waiting
6e3179204289: Waiting
eed2674f7315: Waiting
f5d161bba139: Waiting
1569e0d95ce6: Waiting
4ed121b04368: Waiting
d38adf39e1dd: Waiting
d9d07d703dd5: Waiting
d1dec9917839: Waiting
d9e08da15d0c: Waiting
882fd36bfd35: Waiting
8b4bb7ee456c: Waiting
6b183c62e3d7: Waiting
9fb3eaa92a30: Pushed
343c2ebf14a9: Pushed
ade90bb2cf2b: Pushed
8ba8e88deaf7: Pushed
e8450b31622d: Pushed
0021fcc8e567: Pushed
79e2d5429084: Pushed
eed2674f7315: Pushed
e0f4665cf699: Pushed
8b4bb7ee456c: Pushed
f5d161bba139: Layer already exists
1569e0d95ce6: Layer already exists
d9e08da15d0c: Layer already exists
6b183c62e3d7: Layer already exists
882fd36bfd35: Layer already exists
d1dec9917839: Layer already exists
d38adf39e1dd: Layer already exists
4ed121b04368: Layer already exists
d9d07d703dd5: Layer already exists
5398b6ec2dab: Pushed
4bbd429936f6: Pushed
e85fbaf969fd: Pushed
6e3179204289: Pushed
name unknown: Failed to get blob sizes.
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 45257
Launching Python expansion service @ 44467
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1923297.
Stopping expansion service pid: 1923298.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 330
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 24s
126 actionable tasks: 22 executed, 104 up-to-date
Publishing build scan...
https://gradle.com/s/smll6eolhlkxu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org