You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/07/24 23:28:50 UTC

Build failed in Jenkins: beam_PostCommit_Py_ValCont #9487

See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9487/display/redirect>

Changes:


------------------------------------------
[...truncated 103.34 KB...]
    --temp_location=$GCS_LOCATION/temp-validatesrunner-test \
    --output=$GCS_LOCATION/output \
    --sdk_location=$SDK_LOCATION \
    --num_workers=1 \
    --docker_registry_push_url=$PREBUILD_SDK_CONTAINER_REGISTRY_PATH"
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 900.0s
timeout method: signal
timeout func_only: False
gw0 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [4]

scheduling tests via LoadScheduling

apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 900.0s
timeout method: signal
timeout func_only: False
gw0 I
[gw0] Python 3.8.10 (default, Jun 22 2022, 20:18:18)  -- [GCC 9.4.0]
gw0 [4]

scheduling tests via LoadScheduling

apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer
30d207bf3873: Pushed
20220724-225136719672698: digest: sha256:07d51bf8271ab28bd547b1f000527ff20ec1286133295fce20437e690b5607a0 size: 5361

function cleanup_container {
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container image"
  for image in $(docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH)
    do docker rmi $image || echo "Failed to remove prebuilt sdk container image"
  done
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
  for digest in $(gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk  --format="get(digest)")
    do gcloud container images delete $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk@$digest --force-delete-tags --quiet || echo "Failed to remove prebuilt sdk container image"
  done

>>> Successfully built and push container us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk
  echo "Removed the container"
}
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
trap cleanup_container EXIT

echo ">>> Successfully built and push container $CONTAINER"

cd sdks/python
SDK_LOCATION=$2

# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
pytest -o junit_suite_name=$IMAGE_NAME \
  -m="it_validatescontainer" \
  --show-capture=no \
  --numprocesses=1 \
  --timeout=900 \
  --junitxml=$XUNIT_FILE \
  --ignore-glob '.*py3\d?\.py$' \
  --log-cli-level=INFO \
  --test-pipeline-options=" \
    --runner=TestDataflowRunner \
    --project=$PROJECT \
    --region=$REGION \
    --sdk_container_image=$CONTAINER:$TAG \
    --staging_location=$GCS_LOCATION/staging-validatesrunner-test \
    --temp_location=$GCS_LOCATION/temp-validatesrunner-test \
    --output=$GCS_LOCATION/output \
    --sdk_location=$SDK_LOCATION \
    --num_workers=1 \
    --docker_registry_push_url=$PREBUILD_SDK_CONTAINER_REGISTRY_PATH"
============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 900.0s
timeout method: signal
timeout func_only: False
gw0 I
[gw0] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
gw0 [4]

scheduling tests via LoadScheduling

apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer

[gw0] [ 25%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer

[gw0] [ 25%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer

[gw0] [ 25%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer

[gw0] [ 50%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer

[gw0] [ 50%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer

[gw0] [ 75%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it 
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer

[gw0] [ 75%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it 
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer

[gw0] [ 50%] FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker 
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer

[gw0] [100%] PASSED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it 

=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml> -
============== 4 passed, 2 skipped, 1 warnings in 1685.95 seconds ==============

>>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20220724-225136521005841
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:2cd123142b51c132ff25162e9ae7c65f1d632b2df224a23aaadd88f055ebee71
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:253db925-050d-430f-8483-3fe7bec90e2e
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:0214190d8339fb1bcc8e8ab024646c2ee064c40c33507cef565d0a450aafc7b0
Deleted: sha256:15e6cf1b7cc04d4e36f0c8a05b398ca4732e3cbf192727c67c26b62a5303b9e9
Deleted: sha256:f82bb5086cabc8c210eb74f68f874f3f2fe7cdd8513dec2db945d107fb37f90e
Deleted: sha256:16f1ba86b4c9b4da302cbd578827b008b33aa401cc9bb62f9f02ae022dfb81ba
Deleted: sha256:cdbbd6f8a3739a6de2cb3b2370a31b52769417ed8b1b3d69c93a533e800d826e
Deleted: sha256:e63bc7cb6f49cb137e76f127f823525f4ea745f169432097694e0ff08fa2725d
Deleted: sha256:9202575798f6d83eff4f69275cde7628d52304acdfa928841c840c4d622c6468
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:2cd123142b51c132ff25162e9ae7c65f1d632b2df224a23aaadd88f055ebee71
  Associated tags:
 - 20220724-225136521005841
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20220724-225136521005841
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20220724-225136521005841].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:2cd123142b51c132ff25162e9ae7c65f1d632b2df224a23aaadd88f055ebee71].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:0214190d8339fb1bcc8e8ab024646c2ee064c40c33507cef565d0a450aafc7b0
  Associated tags:
 - 253db925-050d-430f-8483-3fe7bec90e2e
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:253db925-050d-430f-8483-3fe7bec90e2e].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:0214190d8339fb1bcc8e8ab024646c2ee064c40c33507cef565d0a450aafc7b0].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:4dc511df1816a587cad3adc932541b7fac4acbf59d69c2123e4d9102d2d77c31
  Associated tags:
 - ff744f89-9e33-4270-b7d6-0878f5cf6c70
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:ff744f89-9e33-4270-b7d6-0878f5cf6c70].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:4dc511df1816a587cad3adc932541b7fac4acbf59d69c2123e4d9102d2d77c31].
Removed the container

> Task :sdks:python:test-suites:dataflow:py39:validatesContainer

echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:07d51bf8271ab28bd547b1f000527ff20ec1286133295fce20437e690b5607a0
  Associated tags:
 - 20220724-225136719672698
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20220724-225136719672698
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20220724-225136719672698].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:07d51bf8271ab28bd547b1f000527ff20ec1286133295fce20437e690b5607a0].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:d5c0b0e31704094cde8df53d078f0187822566f8f8c13656ebc98553aeef1fcc
  Associated tags:
 - 0a78a75e-9edb-4ec5-9717-fa14a733fc4f
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:0a78a75e-9edb-4ec5-9717-fa14a733fc4f].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:d5c0b0e31704094cde8df53d078f0187822566f8f8c13656ebc98553aeef1fcc].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:4973b1b1803a5ac898348b91a216df20d5efc0bf644c22afe8849de45a7dc7ef
  Associated tags:
 - e1f75238-76a8-41d7-843c-e8b1b5a1d417
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:e1f75238-76a8-41d7-843c-e8b1b5a1d417].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:4973b1b1803a5ac898348b91a216df20d5efc0bf644c22afe8849de45a7dc7ef].

> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
cleanup_container
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:b4fca52d98164fb45805e9a7205b2c0c63417a4d78e1287299ebf9423c17d89a
  Associated tags:
 - 20220724-225136771247437
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20220724-225136771247437
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20220724-225136771247437].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:b4fca52d98164fb45805e9a7205b2c0c63417a4d78e1287299ebf9423c17d89a].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:9619233797d679c941da84263c95a138d0f8ab93a797f63284c542218c312e6a
  Associated tags:
 - 4628ce44-80aa-406b-9277-fe02db1e1f5f
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:4628ce44-80aa-406b-9277-fe02db1e1f5f].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:9619233797d679c941da84263c95a138d0f8ab93a797f63284c542218c312e6a].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:36bd1284f130ee9ef8dcb5e9211d2e46de9e190302fd11488517ea28f1e4b1ef
  Associated tags:
 - f29f30cc-b8c4-45b7-a258-cfd98b44e916
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:f29f30cc-b8c4-45b7-a258-cfd98b44e916].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:36bd1284f130ee9ef8dcb5e9211d2e46de9e190302fd11488517ea28f1e4b1ef].

> Task :sdks:python:test-suites:dataflow:py37:validatesContainer FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 359

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 48m 27s
51 actionable tasks: 41 executed, 4 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/krlulcgkwct6i

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Py_ValCont #9488

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9488/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org