You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/11/25 06:39:16 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Dataflow #1482

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1482/display/redirect>

Changes:


------------------------------------------
[...truncated 57.81 KB...]
Collecting pydot<2,>=1.2.0
  Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting python-dateutil<3,>=2.8.0
  Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting pytz>=2018.3
  Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting requests<3.0.0,>=2.24.0
  Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting typing-extensions<4,>=3.7.0
  Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Collecting dataclasses
  Using cached dataclasses-0.8-py3-none-any.whl (19 kB)
Collecting cachetools<5,>=3.1.0
  Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
  Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
  Using cached google_auth-2.3.3-py2.py3-none-any.whl (155 kB)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.3-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<2,>=0.39.0
  Using cached google_cloud_pubsub-1.7.0-py2.py3-none-any.whl (144 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
  Using cached google_cloud_bigquery-2.30.1-py2.py3-none-any.whl (203 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
  Using cached google_cloud_bigquery_storage-2.10.1-py2.py3-none-any.whl (171 kB)
Collecting google-cloud-core<2,>=0.28.1
  Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.0-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
  Using cached google_cloud_spanner-1.19.1-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
  Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<4,>=0.12.0
  Using cached google_cloud_dlp-3.3.1-py2.py3-none-any.whl (110 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.1-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
  Using cached google_cloud_vision-1.0.0-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting pandas<1.4,>=1.0
  Using cached pandas-1.1.5-cp36-cp36m-manylinux1_x86_64.whl (9.5 MB)
Collecting freezegun>=0.3.12
  Using cached freezegun-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting mock<3.0.0,>=1.0.1
  Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting parameterized<0.8.0,>=0.7.1
  Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
  Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
  Using cached PyYAML-6.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (603 kB)
Collecting requests_mock<2.0,>=1.7
  Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
  Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
  Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
  Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
  Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting sqlalchemy<2.0,>=1.3
  Using cached SQLAlchemy-1.4.27-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5

> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 20.672381 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses

> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/python/container
+ tee /output/licenses/list.csv
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:py36:docker
> Task :sdks:java:container:java8:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker


> Task :runners:google-cloud-dataflow-java:setupXVR

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 42261
Launching Python expansion service @ 39231

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211125060105 --experiments=use_runner_v2 --experiments=shuffle_mode=appliance --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --numprocesses=8 --timeout=4500 --log-cli-level=INFO
>>>   collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.6.13 (default, Feb 20 2021, 21:42:50)  -- [GCC 5.4.0 20160609]
[gw1] Python 3.6.13 (default, Feb 20 2021, 21:42:50)  -- [GCC 5.4.0 20160609]
[gw2] Python 3.6.13 (default, Feb 20 2021, 21:42:50)  -- [GCC 5.4.0 20160609]
[gw4] Python 3.6.13 (default, Feb 20 2021, 21:42:50)  -- [GCC 5.4.0 20160609]
[gw3] Python 3.6.13 (default, Feb 20 2021, 21:42:50)  -- [GCC 5.4.0 20160609]
[gw5] Python 3.6.13 (default, Feb 20 2021, 21:42:50)  -- [GCC 5.4.0 20160609]
[gw7] Python 3.6.13 (default, Feb 20 2021, 21:42:50)  -- [GCC 5.4.0 20160609]
[gw6] Python 3.6.13 (default, Feb 20 2021, 21:42:50)  -- [GCC 5.4.0 20160609]
gw0 [10] / gw1 [10] / gw2 [10] / gw3 [10] / gw4 [10] / gw5 [10] / gw6 [10] / gw7 [10]

scheduling tests via LoadScheduling

apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform 
[gw7] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key 
[gw6] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput 
[gw1] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix 
[gw2] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform 
[gw5] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key 
[gw0] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition 
[gw4] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key 
[gw3] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally 
[gw1] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix 
[gw0] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition 

=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
    self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf'))  # pylint: disable=anomalous-backslash-in-string

apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
    self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'),  # pylint: disable=anomalous-backslash-in-string

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
================== 10 passed, 10 warnings in 1295.18 seconds ===================

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4773.
Stopping expansion service pid: 4774.

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211125060105
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9da079797aa8ce6fcf59d2fc32f5d6c4fd69e6c1f5a2335116b43649ec9f715
Deleted: sha256:542b2a6a6765b09808f299dd18866da8c2ef97b1915370fec0db5197df740852
Deleted: sha256:a0f0b90b34af0ce326f9f653a78db0688506904f336e8ba79b9f1ce29c475e7b
Deleted: sha256:dff65b26948637b97e94aeb4d302ef2e028c68499ce2a7d6b82c6fce5d7037ee
Deleted: sha256:20211ed7d637558e5e2333bb66f75407b560ecb93cbbf3006edcbd9b95e49e8d
Deleted: sha256:8ce0a85c62202d0b3b7cae488e1599ef3c5599bc3236c84dd38248a2288b3429
Deleted: sha256:8617bfb4546a6ce3089ee4e5eba10daa1943057c12546ae20fb28e3974b6af04
Deleted: sha256:9a9d039e0b3e1d41b6680de776a82bb33208925ce0cd3b6d38035772dae1d2da
Deleted: sha256:8e102aa630c2dfe4947263282b7bafb232367ce6f6dc391ab4b9130d14209c7a
Deleted: sha256:ed4316952e622ba5234d0834e637467f207e0f95c1b14e473b53eb35ac4e5e84
Deleted: sha256:1e9aeaa3a1a54134ad088261dc65630c6dd2a3f1d627ec7abb82260578be568c
Deleted: sha256:cb5fd135105a71b245ad88d61b43a70822fd8ef64a723ae9b378abcd23e3853d
Deleted: sha256:5f14b2cfd3d3cb6db140c398b367c9033df8bb988e5f178f03608f8c88ba4809
Deleted: sha256:d2b86b42fa236311fe49006af25397f329f4a50e6e0186cb66c48bf38be8bff4
Deleted: sha256:6b60e59f67ec020c017f3fbbc4195c8ea81d350060d786432e82aa6a9c9b8459
Deleted: sha256:06a9c9730ea5d3e193c482bace0d57c804e2e83044a8a80fd8837d54a9ca09af
Deleted: sha256:cfa3b6640f600a402c621f3192fb800dd6dc79442b03949564fbe6d9af2edd52
Deleted: sha256:bb5779ddb51fe9e9d14625497aab91c55cabf7d0b1fc09b309ff3ecffdab51b1
Deleted: sha256:3fb0a5bbf31aac9acb65c2fb733f7b12aeedc605bbb301cb0241f7c36d9e90e7
Deleted: sha256:a4f6f3ef3fbe5c89602252d28a4f216b5cf14e1ec3fb3162230bfc35d96cb1bb
Deleted: sha256:145a3a0b2e7903d448c45115fa174777898518a12be38617b584585c336c43c1
Deleted: sha256:9fb746a72570d6907307bfaddb54a30f844030d7140c8ed3c3d4c3dab0ce680b
Deleted: sha256:3e636fd44fb34d643e40cfcc8461565158ad8228eecf56ec60ec774e69731a14
Deleted: sha256:a4ddac88f1d1527c593ff7180b5a7e5a71b1b45df58bb9b5d245158632ea6c03
Deleted: sha256:6b1710f705352bc69d13211cff9d5688d0bc0e0f31c76a0ae2ac305c4b0418a4
Deleted: sha256:61831dfb40bad93606d80c3fdc0f5cc85b707905bfef702fd096838fc9441473
Deleted: sha256:1737b0e45db46e9e020a998b8a2a77e54354b9dbf0c5ccaef357f6a74b677a20
Deleted: sha256:b4abd0e62a749e8f7bd6e0bc05e171d4f49e85fedafe562c9ec7712289390c06
Deleted: sha256:3698ec2f9580376593e3e2b404822c87ddc74ccb17c5bdc8b42c344f72893a7e
ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211125060105]

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 38m 43s
132 actionable tasks: 94 executed, 34 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/unl6imyy4lr56

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_XVR_Dataflow #1483

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1483/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org