You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/27 06:51:08 UTC

Build failed in Jenkins: beam_PostCommit_Py_ValCont #8297

See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/8297/display/redirect>

Changes:


------------------------------------------
[...truncated 137.02 KB...]
timeout: 900.0s
timeout method: signal
timeout func_only: False
gw0 I
[gw0] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]

> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
6cff1bfbd207: Pushed
20210927-061522112034896: digest: sha256:e7ea02f52eb7144213df4bfe0953eae88cffd73f72c29786353acccd9ca1d8e4 size: 6398

function cleanup_container {
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container image"
  for image in $(docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH)
    do docker rmi $image || echo "Failed to remove prebuilt sdk container image"
  done
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
  for digest in $(gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk  --format="get(digest)")
    do gcloud container images delete $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk@$digest --force-delete-tags --quiet || echo "Failed to remove prebuilt sdk container image"
  done

  echo "Removed the container"
}
trap cleanup_container EXIT

echo ">>> Successfully built and push container $CONTAINER"

cd sdks/python
>>> Successfully built and push container us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk
SDK_LOCATION=$2

# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
pytest -o junit_suite_name=$IMAGE_NAME \
  -m="it_validatescontainer" \
  --show-capture=no \
  --numprocesses=1 \
  --timeout=900 \
  --junitxml=$XUNIT_FILE \
  --ignore-glob '.*py3\d?\.py$' \
  --log-cli-level=INFO \
  --test-pipeline-options=" \
    --runner=TestDataflowRunner \
    --project=$PROJECT \
    --region=$REGION \
    --sdk_container_image=$CONTAINER:$TAG \
    --staging_location=$GCS_LOCATION/staging-validatesrunner-test \
    --temp_location=$GCS_LOCATION/temp-validatesrunner-test \
    --output=$GCS_LOCATION/output \
    --sdk_location=$SDK_LOCATION \
    --num_workers=1 \
    --prebuild_sdk_container_base_image=$CONTAINER:$TAG \
    --docker_registry_push_url=$PREBUILD_SDK_CONTAINER_REGISTRY_PATH"
============================= test session starts ==============================
platform linux -- Python 3.6.8, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 900.0s
timeout method: signal
timeout func_only: False
gw0 I
[gw0] Python 3.6.8 (default, Dec 24 2018, 19:24:27)  -- [GCC 5.4.0 20160609]
gw0 [4]

scheduling tests via LoadScheduling

apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
gw0 [4]

scheduling tests via LoadScheduling

apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
[gw0] [ 25%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer

[gw0] [ 25%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer

[gw0] [ 50%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer

[gw0] [ 50%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer

[gw0] [ 75%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it 
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer

[gw0] [ 75%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer

[gw0] [100%] PASSED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it 

=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
    self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf'))  # pylint: disable=anomalous-backslash-in-string

apache_beam/io/filesystems_test.py:62
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
    self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'),  # pylint: disable=anomalous-backslash-in-string

<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml> -
=================== 4 passed, 3 warnings in 1979.74 seconds ====================

echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
>>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210927-061521944909637
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:eef322d305fdc88c2836fe024854c78fbd74616561c30f89af635c3c1620eb12
docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:122ee5d7-b9fe-4f5c-b9b8-511d9362b79c
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:baed7a376804c37e1dfe4d791c54eb7dab0cfdb0ad13ea22f0b6e9d5775f87de
Deleted: sha256:6a4a8fcb130cae38e7416663369e28cd854fd3d82aa16aab250511779514b0fc
Deleted: sha256:e90c59812903127be5bd94770db84d762ef59e97f4919637e983b19ce32802c4
Deleted: sha256:b2473ea0cccfd7f6864caac7ac50d9ee0bebe239cdd571bafb2962017f928fca
Deleted: sha256:9935453b5504db27d277f9b2b518baad2fd94eeabe1aa9eb8aa41cc5d009f799
Deleted: sha256:4d52de1a8eccae69827778ea76a23206d0dcf48da64a8ccd017614767d29a2ae
Deleted: sha256:df296cd886c4a90aafd9b1ef987a731a085780d993fcc8e54b0e802e90276a7b
Deleted: sha256:5be45e90066fa716c85adfbb3e4d378e3d2d82df3933532e066bc30805c7e0a7
Deleted: sha256:58b09808191dd83bfa106c1badb20a29e022ab2febd89fbf14f79d0ead0fbeee
Deleted: sha256:3c48bb977111dcfd878bfd7a195926436da726aff58c44f84c1cee59bbdaf211
Deleted: sha256:25b4559b1ae7b8f64ae1542362a1e3073da8c018f84dad58b005c762c32e992f
Deleted: sha256:dd9935a41ca62851bb47e38573d763627fcdf2dde46fade9ddf72725bd4f8e11
Deleted: sha256:3175085b0ec3d7492e9f42f5458e5714ec6eee8ac1548d9908bb256bd029f7e5
Deleted: sha256:5cac67f1d28cde34256b8d435d1b11e658dbc4b638a3b2989e81da1d3e69ce2f
Deleted: sha256:048a81eb501432092c86c56e91a19706ea033a0cbdf5cea8fbf0033481dd4a56
Deleted: sha256:8977d6d99c0a5aeeacb9a3125d1d555ae239db238632cbfbad034dd326a95d29
Deleted: sha256:df0b619116ecce60e7e5627b27f1e0c25be53c9cdf9f23746772ddf7ee64444e
Deleted: sha256:e528424ebdf67467d0a0daab9afe89c650e608c39ff3d1e6a816766b4cf49ce5
Deleted: sha256:03670c4512e8a591b5b1aef85861382ac136fee9a6282ab8224da80239579d4b
Deleted: sha256:b5157e9583a23e4f9165f29a204520f62fd9f6b48d21f0c03a2b046310f5de9f
Deleted: sha256:42451237b03ad1b6b2dbb9a455b949dc89497fdd4427eb94765b5c58149228a7
Deleted: sha256:38b1b4e339bb0fe0eb869a9c6c04b991263be5a426258065439d902272095d5c
Deleted: sha256:d1c8fbb441743957b3c647a617b562efbf2ca604d68d1045e5eef4bf388fdff5
Deleted: sha256:a548a0e18b00188064832ea68bdba8bf3d1caa80ceaaf8b5e38984c634c4b214
Deleted: sha256:55c4389d570a89e169089db586228d2f285fd65842e50d2dc7ae0bfd6717e891
Deleted: sha256:cf4a6e5bbf703c6aa4a0b764892aa2f1826a3f140eb908115f2cd0a8c378059f
Deleted: sha256:c662afca48b71ad05cf9d17cb1b5a255bee47daf5fdc8a647914d0cdc68a2f66
Deleted: sha256:444dd6c42f7cf643e8ddcabe3e466cd1e725750f5192dde8fc331bd79f32b982
Deleted: sha256:0ffd264b7aeab62a57e234f24724bf93177485042c2b1f362189b4e82878278f
Deleted: sha256:1964fd7124bd7498c2c7d832e48e2450d4a39b9471bd3c411a42cc75f966c7b3
Deleted: sha256:e6863b7661bf38524fdc2ef58e9091cb4ffab48712d8bf621900774d68ea19d2
Deleted: sha256:7b55148cdd066d81b924879ae21d371caa739bb4af5d8a99f7517bbcd5dcabfb
Deleted: sha256:b0f8bc2e21892874acd0c0630bfbdd539087cd0909500bb3f7171f71ecc7cd82
Deleted: sha256:384e33653c72ad57ec8e5840795fc0e49f0452ce72dcc70f1407644ee69e0077
Deleted: sha256:5460017b1ec74b4bc7c430afa7760548a49fcfbb917f3ec688aa549a58eb11e2
Deleted: sha256:c8aa600a728a73471185f4d155d8b1c4d2ca4c347e1da660c4fd884f71b8b591
Deleted: sha256:eec1d5bd8c3d60ee1c0335767dee7a8d6e9807de787486f0d9c8495ed3e0b066
Deleted: sha256:184b331469e5986d13acf9a02e400c8710ee003aa9d3e71e2e0792d7650f4290
Deleted: sha256:5b349fc05cc66c2ab73bc8a84d096db6707e8bd1d18d0a4f7a37c1a208f46a07
Deleted: sha256:4a628ad13675ca5b3c5b46d193281d053433eac52081cc193bc5ffe98a331699
Deleted: sha256:9670130f3ed862fd2f27e19f1a91bca918d3b6f896f5da82de05e8fc0d059e20
Deleted: sha256:1d98e7329fcce1e7073b8804d7ad2093772d1c19a99f8adbdff44d1a86e75110
Deleted: sha256:ce3ffc96e6e69eb6323ad762b8ade89f2d94aac9fbe492b6876ddf4fa1b744f7
Deleted: sha256:d0d9e5d548551137ebf2ad61c284e5dae6ef4d50d3a31f458825f4a6472d09f6
Deleted: sha256:03ca59bf6294e1c30f19e1bf304209c66a20d48b12458b3a3c039f63efe7322a
Deleted: sha256:8f886ba46614c8e00475dc2f2a91a0090f45c8a0e4856358c75760ce8baafcab
Deleted: sha256:7615e0688743fdeb405f1cf40373ace2c13248a0ebf5f31596df884625692a98
Deleted: sha256:b665ae52174f0e8ab17c9f58a2bf20d9ee1f0ef44f14a77d26b00083b8c26900
Deleted: sha256:1b638a08ea3b09d3a245fb51f621bdbe4049b0f588cf4c3f9a4c2ae51b37b15d
Deleted: sha256:9f975a6feba72741279c9a677963c059ce65760cb0228093a6b2b4768e271799
Deleted: sha256:d94fa3d026a322e9706ad6c6aef6d13aac7eef7bd3b39bc93175112369df3aea
Deleted: sha256:8f686d16a61f46aa27ef37a00ff45032491249b0685dc1182a1b90c508c99941
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:eef322d305fdc88c2836fe024854c78fbd74616561c30f89af635c3c1620eb12
  Associated tags:
 - 20210927-061521944909637
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210927-061521944909637
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210927-061521944909637].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:eef322d305fdc88c2836fe024854c78fbd74616561c30f89af635c3c1620eb12].
gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk  --format="get(digest)"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:baed7a376804c37e1dfe4d791c54eb7dab0cfdb0ad13ea22f0b6e9d5775f87de
  Associated tags:
 - 122ee5d7-b9fe-4f5c-b9b8-511d9362b79c
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:122ee5d7-b9fe-4f5c-b9b8-511d9362b79c].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:baed7a376804c37e1dfe4d791c54eb7dab0cfdb0ad13ea22f0b6e9d5775f87de].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:d04b4fb4ba569a45a245f84b651e3ce46f561ed5db052ecd298d6ef5af6621fb
  Associated tags:
 - a6e08eeb-c0e9-4b55-856a-815992897b0e
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:a6e08eeb-c0e9-4b55-856a-815992897b0e].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:d04b4fb4ba569a45a245f84b651e3ce46f561ed5db052ecd298d6ef5af6621fb].
Removed the container

> Task :sdks:python:test-suites:dataflow:py36:validatesContainer

echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:e7ea02f52eb7144213df4bfe0953eae88cffd73f72c29786353acccd9ca1d8e4
  Associated tags:
 - 20210927-061522112034896
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210927-061522112034896
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210927-061522112034896].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:e7ea02f52eb7144213df4bfe0953eae88cffd73f72c29786353acccd9ca1d8e4].
gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk  --format="get(digest)"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:d2e8e6fd289c0ddf21ce978f30371e9a92f7d8cc4c629a143559d7089a226962
  Associated tags:
 - 6f7a1eb7-9f57-4b39-a788-22d5361d76cb
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:6f7a1eb7-9f57-4b39-a788-22d5361d76cb].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:d2e8e6fd289c0ddf21ce978f30371e9a92f7d8cc4c629a143559d7089a226962].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:c3a677393ae616b3afc44736de81c409b8ee7fe0ffa253c5a6ce05e679fc712f
  Associated tags:
 - a2b5d79d-790c-4cf9-8364-94d03ec95f81
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:a2b5d79d-790c-4cf9-8364-94d03ec95f81].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:c3a677393ae616b3afc44736de81c409b8ee7fe0ffa253c5a6ce05e679fc712f].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py37:docker'.
> Process 'command 'docker'' finished with non-zero exit value 2

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 50m 37s
43 actionable tasks: 39 executed, 4 up-to-date

Publishing build scan...
https://gradle.com/s/2v3rdmg47u7o4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Py_ValCont #8298

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/8298/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org