You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/04/13 18:46:32 UTC
Build failed in Jenkins: beam_PostCommit_Py_ValCont #7672
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/7672/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-11712] Make up-to-date build file and codestyle
[Ismaël Mejía] [BEAM-11712] Add options for input/output paths, make it run via
[Ismaël Mejía] [BEAM-11712] Fix static analysis warnings and typos on TPC-DS module
[aromanenko.dev] Fix W201 Trailing whitespace
[Kenneth Knowles] Allow manual trigger of wheel build
[noreply] [BEAM-12069] Move test_utils.py mock import inside function (#14511)
------------------------------------------
[...truncated 112.95 KB...]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 3.6550214807074055 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1618337967139/results*-of-*
Traceback for above exception (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 260, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 122, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 7.790883428091464 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1618337967139/results*-of-*
Traceback for above exception (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 260, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 122, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 13.382812354372184 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1618337967139/results*-of-*
Traceback for above exception (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 260, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 122, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 20.292117279547544 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1618337967139/results*-of-*
Traceback for above exception (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 260, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 122, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
> Task :sdks:python:test-suites:dataflow:py36:validatesContainer
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
----------------------------------------------------------------------
XML: nosetests-beam_python3.6_sdk.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 4 tests in 1505.338s
OK
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:2ae830fe72d6610d092de6210bc264583d08386783f5a0a7b7c39e0025c07981
Associated tags:
- 20210413-181746949145168
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210413-181746949145168
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210413-181746949145168].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:2ae830fe72d6610d092de6210bc264583d08386783f5a0a7b7c39e0025c07981].
gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:f024b4e00825692baa9ac845eb93b3e97d90b63e68bf14fbbfcea4f414ef0842
Associated tags:
- d0a9056d-f641-47a6-bc22-92df766b3818
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:d0a9056d-f641-47a6-bc22-92df766b3818].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:f024b4e00825692baa9ac845eb93b3e97d90b63e68bf14fbbfcea4f414ef0842].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:b4de1650556260ac47113f0ac31c7a2aa43f48f1e68ebdf4c2b14eb95dd2bd56
Associated tags:
- af17bff3-9c8b-40ee-885d-2e5a89126b69
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:af17bff3-9c8b-40ee-885d-2e5a89126b69].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:b4de1650556260ac47113f0ac31c7a2aa43f48f1e68ebdf4c2b14eb95dd2bd56].
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
======================================================================
ERROR: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 55, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 112, in _run_wordcount_it
save_main_session=False,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 89, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 578, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 533, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 557, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 72, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hamcrest/core/assert_that.py",> line 44, in assert_that
_assert_match(actual=arg1, matcher=arg2, reason=arg3)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hamcrest/core/assert_that.py",> line 52, in _assert_match
if not matcher.matches(actual):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hamcrest/core/core/allof.py",> line 19, in matches
if not matcher.matches(item):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hamcrest/core/base_matcher.py",> line 28, in matches
match_result = self._matches(item)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 142, in _matches
read_lines = self._read_with_retry()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 273, in wrapper
raise_with_traceback(exn, exn_traceback)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/future/utils/__init__.py",> line 446, in raise_with_traceback
raise exc.with_traceback(traceback)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py",> line 260, in wrapper
return fun(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 122, in _read_with_retry
raise IOError('No such file or directory: %s' % self.file_path)
OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1618337967139/results*-of-*
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-04-13_11_19_28-17339142403242232475?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-beam_python3.7_sdk.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 4 tests in 1526.736s
FAILED (errors=1)
cleanup_container
docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:f59497e55b1cd3ac297424efd567993f51486ae2a431576c099ad25778f740c9
Associated tags:
- 20210413-181743829172047
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210413-181743829172047
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210413-181743829172047].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:f59497e55b1cd3ac297424efd567993f51486ae2a431576c099ad25778f740c9].
gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:50291b2a2093d2cff5342b96d9fc3d90195ae8811196ba914518f2edacb6bec9
Associated tags:
- a5e2a096-a02b-4672-94a2-0a37fdee5ae9
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:a5e2a096-a02b-4672-94a2-0a37fdee5ae9].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:50291b2a2093d2cff5342b96d9fc3d90195ae8811196ba914518f2edacb6bec9].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:74dbafa905f4588ff4560d9d424ba79cd3e71437a6ea66fd001628dc9a81d308
Associated tags:
- f5be8165-1c63-4e73-846d-dbaad78c7874
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:f5be8165-1c63-4e73-846d-dbaad78c7874].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:74dbafa905f4588ff4560d9d424ba79cd3e71437a6ea66fd001628dc9a81d308].
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
----------------------------------------------------------------------
XML: nosetests-beam_python3.8_sdk.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 4 tests in 1560.982s
OK
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:1a9e59ae0ce520d428261eb8fa3a16f1ce0522597dd2e4c178b25a0145ad0add
Associated tags:
- 20210413-181836654631021
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210413-181836654631021
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210413-181836654631021].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:1a9e59ae0ce520d428261eb8fa3a16f1ce0522597dd2e4c178b25a0145ad0add].
gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:d24677700d9d63480dfa6e8ea3a26bf69861b5c3eba61c2f4a80132a77f464e9
Associated tags:
- 19917f6e-68f0-4f3a-b21a-199d946cc8c5
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:19917f6e-68f0-4f3a-b21a-199d946cc8c5].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:d24677700d9d63480dfa6e8ea3a26bf69861b5c3eba61c2f4a80132a77f464e9].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:0bdd0529fbb32788568e56c367f54b9e880bb43c6a0e939a4fc11ddcc9ece0e2
Associated tags:
- ad416476-fc71-4c9c-b887-5c8e77cc9353
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:ad416476-fc71-4c9c-b887-5c8e77cc9353].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:0bdd0529fbb32788568e56c367f54b9e880bb43c6a0e939a4fc11ddcc9ece0e2].
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 248
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 46m 0s
51 actionable tasks: 47 executed, 4 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.
Publishing build scan...
https://gradle.com/s/is2re4yal3yey
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Py_ValCont #7673
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/7673/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org