You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/05/04 06:49:32 UTC
Build failed in Jenkins: beam_PostCommit_Py_ValCont #7754
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/7754/display/redirect?page=changes>
Changes:
[Alan Myrvold] [BEAM-10912] Increase Jenkins job logs retention from 14 to 30 days
[Pablo Estrada] Revert "Merge pull request #13617 from [BEAM-11289] [Python] Integrate
[Pablo Estrada] Revert type: ignore caused by PR 13617
------------------------------------------
[...truncated 115.69 KB...]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 3.699920817034947 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-*
Traceback for above exception (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 253, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 120, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 8.595824543540447 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-*
Traceback for above exception (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 253, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 120, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 16.119571492984747 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-*
Traceback for above exception (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 253, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 120, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 27.72818587758053 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-*
Traceback for above exception (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 253, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 120, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
----------------------------------------------------------------------
XML: nosetests-beam_python3.7_sdk.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 4 tests in 1495.767s
OK
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:0af981543860b0ba67a8254d037376332f49531985b28c5653b09eb03b4fa408
Associated tags:
- 20210504-062111518716913
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210504-062111518716913
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210504-062111518716913].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:0af981543860b0ba67a8254d037376332f49531985b28c5653b09eb03b4fa408].
gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:11c5536dbd457e567be5e986374d54f481059580d9613639166063fde144b533
Associated tags:
- 1bdcd92a-c9de-4164-9855-60a3381bc8e5
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:1bdcd92a-c9de-4164-9855-60a3381bc8e5].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:11c5536dbd457e567be5e986374d54f481059580d9613639166063fde144b533].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:9c7e69bab81452d8a05d559bc811064e0083661c3fac6d149304153d6c1c40bb
Associated tags:
- 16d7a75f-b6e8-4485-8991-adafd2224f24
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:16d7a75f-b6e8-4485-8991-adafd2224f24].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:9c7e69bab81452d8a05d559bc811064e0083661c3fac6d149304153d6c1c40bb].
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
======================================================================
ERROR: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 55, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 112, in _run_wordcount_it
save_main_session=False,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 89, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 582, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 537, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 561, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 69, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/hamcrest/core/assert_that.py",> line 44, in assert_that
_assert_match(actual=arg1, matcher=arg2, reason=arg3)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/hamcrest/core/assert_that.py",> line 52, in _assert_match
if not matcher.matches(actual):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/hamcrest/core/core/allof.py",> line 19, in matches
if not matcher.matches(item):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/hamcrest/core/base_matcher.py",> line 28, in matches
match_result = self._matches(item)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 140, in _matches
read_lines = self._read_with_retry()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 266, in wrapper
raise exn.with_traceback(exn_traceback)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 253, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 120, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-*
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-03_23_23_39-8035051870230003291?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-beam_python3.6_sdk.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 4 tests in 1528.812s
FAILED (errors=1)
cleanup_container
docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:7ccc1ec1eb5b971437d4a44b17f67c1052d2d946a519675d0e557d85f316f299
Associated tags:
- 20210504-062113534638794
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210504-062113534638794
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210504-062113534638794].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:7ccc1ec1eb5b971437d4a44b17f67c1052d2d946a519675d0e557d85f316f299].
gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:e8b9ddbc3c1d08bcb507b250f6db171fe3ecbc6ef792d1bc6f8f73365c1bc73a
Associated tags:
- e292b0fe-d546-47ba-896e-2f3fcff196f0
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:e292b0fe-d546-47ba-896e-2f3fcff196f0].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:e8b9ddbc3c1d08bcb507b250f6db171fe3ecbc6ef792d1bc6f8f73365c1bc73a].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:f3941fb25a62bf5cc98b3ec4d1d87c9a1659be59d276f22e5b8823b728486e65
Associated tags:
- a10b5beb-218c-494b-b78d-224582c263ac
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:a10b5beb-218c-494b-b78d-224582c263ac].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:f3941fb25a62bf5cc98b3ec4d1d87c9a1659be59d276f22e5b8823b728486e65].
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
----------------------------------------------------------------------
XML: nosetests-beam_python3.8_sdk.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 4 tests in 1537.852s
OK
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:951c8a95b8f0db3499347fcf8e98aa1e92bcb3ce71c7e17ad5ecbbf64bb32054
Associated tags:
- 20210504-062149670848720
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210504-062149670848720
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210504-062149670848720].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:951c8a95b8f0db3499347fcf8e98aa1e92bcb3ce71c7e17ad5ecbbf64bb32054].
gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:747eb88e5941333e6e866f4e60aab632150b50da9425295dd15779ca0f84127c
Associated tags:
- 3b32b753-89f6-4e22-8871-c19129103eca
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:3b32b753-89f6-4e22-8871-c19129103eca].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:747eb88e5941333e6e866f4e60aab632150b50da9425295dd15779ca0f84127c].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:d60b76ba58c1c26c6df08f408d1fe89a4376c2f7a7302190e02c58641014ad61
Associated tags:
- 26ab4f49-3031-4675-86dc-23d3536b4c00
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:26ab4f49-3031-4675-86dc-23d3536b4c00].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:d60b76ba58c1c26c6df08f408d1fe89a4376c2f7a7302190e02c58641014ad61].
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 248
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py36:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 49m 2s
51 actionable tasks: 47 executed, 4 up-to-date
Publishing build scan...
https://gradle.com/s/acwii7iodsdtk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Py_ValCont #7755
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/7755/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org