You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/10/13 05:35:35 UTC
Build failed in Jenkins: beam_PostCommit_Py_ValCont #9808
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9808/display/redirect?page=changes>
Changes:
[noreply] Extend a timeout to create a bt cluster. (#23617)
------------------------------------------
[...truncated 1.45 MB...]
[gw0] [ 75%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
[gw0] [100%] PASSED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it
=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.7_sdk.xml> -
============ 4 passed, 3 skipped, 2 warnings in 2153.55s (0:35:53) =============
>>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221013-045338996959258
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:87ae673136f7eb1bad1515b9bd106780be1a6268d8a4f8997cd30d9067084ac2
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:4aaa7a75-0f8e-415d-abf2-b92eb76b6d67
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:49d1af1aa43b6f87eb0bb91939c12b02fc8a9971b14b3a3833f100444fb4b676
Deleted: sha256:10e69bc4562ebbe02ee5f07c358a11d1aca53fd56e93b72737c8c8e74bd27186
Deleted: sha256:83cca30511e6ef90328960d2a2c09735cea76626da4a346c6892bc896821eb27
Deleted: sha256:68bf186ded29363aa97d793bdd869f48c05bc55fe0508b1e100a4fd9cad976d3
Deleted: sha256:56d44972f7782afb62ac739ac7fee8edefc5f2f14fb2ffd22bb7ca48fabbb563
Deleted: sha256:0d1e0dda2b1b62645e86a4cd5dee8d4b9440d62ee233b532d3d0d1ba18b436b2
Deleted: sha256:1dee786c789ec3c798b6c7b999619632cc29389722eaec13bfff60001c8845f7
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:87ae673136f7eb1bad1515b9bd106780be1a6268d8a4f8997cd30d9067084ac2
Associated tags:
- 20221013-045338996959258
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221013-045338996959258
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221013-045338996959258].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:87ae673136f7eb1bad1515b9bd106780be1a6268d8a4f8997cd30d9067084ac2].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:49d1af1aa43b6f87eb0bb91939c12b02fc8a9971b14b3a3833f100444fb4b676
Associated tags:
- 4aaa7a75-0f8e-415d-abf2-b92eb76b6d67
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:4aaa7a75-0f8e-415d-abf2-b92eb76b6d67].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:49d1af1aa43b6f87eb0bb91939c12b02fc8a9971b14b3a3833f100444fb4b676].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:e73a182b764ba2fa80c055398d9658aa04cb10597aeef54f3b6c3f6b06c52672
Associated tags:
- 7052379b-6ebc-45b5-b192-2f086d9d275e
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:7052379b-6ebc-45b5-b192-2f086d9d275e].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:e73a182b764ba2fa80c055398d9658aa04cb10597aeef54f3b6c3f6b06c52672].
Removed the container
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer
[gw0] [100%] PASSED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it
=================================== FAILURES ===================================
____ WordCountIT.test_wordcount_it_with_prebuilt_sdk_container_cloud_build _____
[gw0] linux -- Python 3.9.10 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/bin/python3.9>
self = <apache_beam.examples.wordcount_it_test.WordCountIT testMethod=test_wordcount_it_with_prebuilt_sdk_container_cloud_build>
@pytest.mark.it_validatescontainer
def test_wordcount_it_with_prebuilt_sdk_container_cloud_build(self):
> self._run_wordcount_it(
wordcount.run,
experiment='beam_fn_api',
prebuild_sdk_container_engine='cloud_build')
apache_beam/examples/wordcount_it_test.py:103:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/examples/wordcount_it_test.py:146: in _run_wordcount_it
run_wordcount(
apache_beam/examples/wordcount.py:106: in run
output | 'Write' >> WriteToText(known_args.output)
apache_beam/pipeline.py:597: in __exit__
self.result = self.run()
apache_beam/pipeline.py:547: in run
return Pipeline.from_runner_api(
apache_beam/pipeline.py:574: in run
return self.runner.run_pipeline(self, self._options)
apache_beam/runners/dataflow/test_dataflow_runner.py:66: in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <DataflowPipelineResult <Job
clientRequestId: '20221013051317425272-9986'
createTime: '2022-10-13T05:13:18.480573Z'
...022-10-13T05:13:18.480573Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7fe60baaefa0>
duration = None
def wait_until_finish(self, duration=None):
if not self.is_in_terminal_state():
if not self.has_job:
raise IOError('Failed to get the Dataflow job id.')
consoleUrl = (
"Console URL: https://console.cloud.google.com/"
f"dataflow/jobs/<RegionId>/{self.job_id()}"
"?project=<ProjectId>")
thread = threading.Thread(
target=DataflowRunner.poll_for_job_completion,
args=(self._runner, self, duration))
# Mark the thread as a daemon thread so a keyboard interrupt on the main
# thread will terminate everything. This is also the reason we will not
# use thread.join() to wait for the polling thread.
thread.daemon = True
thread.start()
while thread.is_alive():
> time.sleep(5.0)
E Failed: Timeout >900.0s
apache_beam/runners/dataflow/dataflow_runner.py:1622: Failed
=============================== warnings summary ===============================
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:66
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:89
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.9_sdk.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build
======= 1 failed, 3 passed, 3 skipped, 6 warnings in 2244.53s (0:37:24) ========
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221013-045339042838400
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:c540df0124e20312c053dcc7616fc5032ac6b9f7ebadb674709161fc6774e2dc
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:7005ec2b-531f-4508-b77d-650c3d6d2005
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:c8c9f3dc72cb9c45f7fc6b3f89a5c00788a9be31b067cb78a8f5f703e199d85e
Deleted: sha256:db9d704798b73abebe026bde4d3bc8edb259c7eee0c9469c3d1d395d7bb505c8
Deleted: sha256:d0c043ca35c865e29a0982745c6118aafe25c1cdfd91e18a5743b48a80cc3435
Deleted: sha256:118fec2e067ef9f6c9fd3be617cd67d48af5d3111a24b8ea18560ae3022b337e
Deleted: sha256:00ed32eacf08fea24627a10d8995565fd74f5acf328b04716f1b85e024fa21b4
Deleted: sha256:d7fe5438818991f1ee021488d67c612e3d09ca8835e1625523cbad2031e47b96
Deleted: sha256:a1268f437e985a0ba78521fa4b0eaf75de30dd1ed435e8735e54d96f3acaa680
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:c540df0124e20312c053dcc7616fc5032ac6b9f7ebadb674709161fc6774e2dc
Associated tags:
- 20221013-045339042838400
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221013-045339042838400
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221013-045339042838400].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:c540df0124e20312c053dcc7616fc5032ac6b9f7ebadb674709161fc6774e2dc].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:c8c9f3dc72cb9c45f7fc6b3f89a5c00788a9be31b067cb78a8f5f703e199d85e
Associated tags:
- 7005ec2b-531f-4508-b77d-650c3d6d2005
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:7005ec2b-531f-4508-b77d-650c3d6d2005].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:c8c9f3dc72cb9c45f7fc6b3f89a5c00788a9be31b067cb78a8f5f703e199d85e].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:d246ef14d05cbf6c82227eb6a0a2d57b383413ddce8e610e68c6f196dfb438a0
Associated tags:
- 137c4fd5-9ad9-4159-898d-45d4876088fd
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:137c4fd5-9ad9-4159-898d-45d4876088fd].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:d246ef14d05cbf6c82227eb6a0a2d57b383413ddce8e610e68c6f196dfb438a0].
Removed the container
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
cleanup_container
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:2290228ee5692de94811c384a16ada5e03c4d023f5ff9c6896bf3fb33ceda5e3
Associated tags:
- 20221013-045338836467317
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221013-045338836467317
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221013-045338836467317].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:2290228ee5692de94811c384a16ada5e03c4d023f5ff9c6896bf3fb33ceda5e3].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:b43abed5bb8d7deb1268928fce07938d0ec2a79f889c915078c58664f3d5de5c
Associated tags:
- b5694194-af2b-4490-b881-b59e426ff634
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:b5694194-af2b-4490-b881-b59e426ff634].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:b43abed5bb8d7deb1268928fce07938d0ec2a79f889c915078c58664f3d5de5c].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:34791d3de70556e922ca8e6c9fe830c482312fb1ffe568eaffe79a774f68de97
Associated tags:
- 18177ddf-ead2-497c-902b-7662c910525f
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:18177ddf-ead2-497c-902b-7662c910525f].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:34791d3de70556e922ca8e6c9fe830c482312fb1ffe568eaffe79a774f68de97].
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 359
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 359
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 54m 34s
51 actionable tasks: 41 executed, 4 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/lbz3lwxh2axcg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Py_ValCont #9809
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9809/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org