You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/16 00:58:39 UTC

Build failed in Jenkins: beam_PostCommit_XVR_JavaUsingPython_Dataflow #188

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/188/display/redirect?page=changes>

Changes:

[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored java

[dhuntsperger] adding a list of example pipelines

[dhuntsperger] removing unnecessary `ls` command from maven project generation

[dhuntsperger] fixing filename formatting in response to feedback

[dhuntsperger] adding extra step emphasizing runner setupt

[dhuntsperger] reorganized instructions to emphasize setup steps for runners

[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support

[noreply] Adding pydoc for StateHandler (#17091)

[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)


------------------------------------------
[...truncated 526.02 KB...]
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container 06b1217eacb0
 ---> cbffa37db42c
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> 8362f6372582
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> fe3f7424edb9
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> 034d160df66e
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 7e816203f1fb
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 62601e42e5d8
Removing intermediate container 62601e42e5d8
 ---> b616c62734c4
Step 21/31 : FROM beam as third_party_licenses
 ---> b616c62734c4
Step 22/31 : ARG pull_licenses
 ---> Running in 747c9f75cb70
Removing intermediate container 747c9f75cb70
 ---> 481686474ca0
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 3e379a12a324
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> a2fd18dba1b3
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 0da8762308ea
Removing intermediate container 0da8762308ea
 ---> b06284092e7e
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 8eb7cb370671
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in cc45ec57789b
Collecting pip-licenses<3.0.0
  Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=f9d5ac0fac77df182d16b7d7916d1a3844e32940d827e37493e79ae95e406749
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
WARNING: You are using pip version 21.2.4; however, version 22.0.4 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
INFO:root:Successfully pulled licenses for 137 dependencies
Skip pulling license for  bs4
Removing intermediate container cc45ec57789b
 ---> 2ec4c2520875
Step 28/31 : FROM beam
 ---> b616c62734c4
Step 29/31 : ARG pull_licenses
 ---> Running in df032c6b6c0f
Removing intermediate container df032c6b6c0f
 ---> 848975ffb700
Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
 ---> 7f43b92a3a19
Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then       rm -rf /opt/apache/beam/third_party_licenses ;     fi
 ---> Running in bce849234bbb
Removing intermediate container bce849234bbb
 ---> ac5dc4d90e0e
Successfully built ac5dc4d90e0e
Successfully tagged apache/beam_python3.9_sdk:2.38.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
3ec69926faef: Preparing
7f5b0896d874: Preparing
3e78b62bbfdd: Preparing
7ab24a4baa2d: Preparing
a3eedd9c4f74: Preparing
1e775e0ed91a: Preparing
33689c792df7: Preparing
4dc6c8e88d97: Preparing
dd29c3bc5f42: Preparing
1e775e0ed91a: Waiting
f9a347c2a92a: Preparing
6ab8b8c3d2ef: Preparing
f9a347c2a92a: Waiting
fdab12d90c27: Preparing
04bc0612b0cf: Preparing
6ab8b8c3d2ef: Waiting
fdab12d90c27: Waiting
1d057a06136d: Preparing
db3e5ba12531: Preparing
04bc0612b0cf: Waiting
5bac4195a2ad: Preparing
c8e787ed62ea: Preparing
db3e5ba12531: Waiting
3738fd399239: Preparing
5bac4195a2ad: Waiting
182f3ce3bf27: Preparing
316e3949bffa: Preparing
e3f84a8cee1f: Preparing
c8e787ed62ea: Waiting
48144a6f44ae: Preparing
26d5108b2cba: Preparing
3738fd399239: Waiting
182f3ce3bf27: Waiting
89fda00479fc: Preparing
48144a6f44ae: Waiting
316e3949bffa: Waiting
e3f84a8cee1f: Waiting
89fda00479fc: Waiting
26d5108b2cba: Waiting
dd29c3bc5f42: Waiting
1d057a06136d: Waiting
33689c792df7: Waiting
3e78b62bbfdd: Pushed
3ec69926faef: Pushed
7ab24a4baa2d: Pushed
a3eedd9c4f74: Pushed
33689c792df7: Pushed
1e775e0ed91a: Pushed
dd29c3bc5f42: Pushed
7f5b0896d874: Pushed
f9a347c2a92a: Pushed
6ab8b8c3d2ef: Pushed
1d057a06136d: Pushed
5bac4195a2ad: Layer already exists
c8e787ed62ea: Layer already exists
3738fd399239: Layer already exists
182f3ce3bf27: Layer already exists
316e3949bffa: Layer already exists
e3f84a8cee1f: Layer already exists
48144a6f44ae: Layer already exists
db3e5ba12531: Pushed
26d5108b2cba: Layer already exists
89fda00479fc: Layer already exists
4dc6c8e88d97: Pushed
fdab12d90c27: Pushed
04bc0612b0cf: Pushed
20220316003132: digest: sha256:14b7cfd20cac24037b05dbae0bbfb1631d97ebbadb9ff6253299521dfea10264 size: 5361

> Task :runners:google-cloud-dataflow-java:setupXVR

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 37319
Launching Python expansion service @ 39933

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython FAILED

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 805581.
Stopping expansion service pid: 805582.

> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE

> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220316003132
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14b7cfd20cac24037b05dbae0bbfb1631d97ebbadb9ff6253299521dfea10264
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220316003132]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14b7cfd20cac24037b05dbae0bbfb1631d97ebbadb9ff6253299521dfea10264]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220316003132] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14b7cfd20cac24037b05dbae0bbfb1631d97ebbadb9ff6253299521dfea10264])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14b7cfd20cac24037b05dbae0bbfb1631d97ebbadb9ff6253299521dfea10264
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14b7cfd20cac24037b05dbae0bbfb1631d97ebbadb9ff6253299521dfea10264
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14b7cfd20cac24037b05dbae0bbfb1631d97ebbadb9ff6253299521dfea10264].

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316003132
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bd96b3fc046ca3e8b00d851319b09be2ce6bffb84ebeaa9c2280182cecfa655
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316003132]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bd96b3fc046ca3e8b00d851319b09be2ce6bffb84ebeaa9c2280182cecfa655]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316003132] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bd96b3fc046ca3e8b00d851319b09be2ce6bffb84ebeaa9c2280182cecfa655])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bd96b3fc046ca3e8b00d851319b09be2ce6bffb84ebeaa9c2280182cecfa655
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bd96b3fc046ca3e8b00d851319b09be2ce6bffb84ebeaa9c2280182cecfa655
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bd96b3fc046ca3e8b00d851319b09be2ce6bffb84ebeaa9c2280182cecfa655].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'.
> Failed to store cache entry for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 27m 5s
157 actionable tasks: 25 executed, 132 up-to-date

Publishing build scan...
https://gradle.com/s/nh26hrceqxcnu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_XVR_JavaUsingPython_Dataflow #189

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/189/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org