You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/10/02 05:32:05 UTC

Build failed in Jenkins: beam_PostCommit_Py_ValCont #9764

See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9764/display/redirect>

Changes:


------------------------------------------
[...truncated 1.36 MB...]
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/api_core/grpc_helpers.py>:37: DeprecationWarning: Support for grpcio-gcp is deprecated. This feature will be
              removed from `google-api-core` after January 1, 2024. If you need to
              continue to use this feature, please pin to a specific version of
              `google-api-core`.
    warnings.warn(

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/typehints/pandas_type_compatibility_test.py:66
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    }).set_index(pd.Int64Index(range(123, 223), name='an_index')),

apache_beam/typehints/pandas_type_compatibility_test.py:89
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    pd.Int64Index(range(123, 223), name='an_index'),

apache_beam/typehints/pandas_type_compatibility_test.py:90
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    pd.Int64Index(range(475, 575), name='another_index'),

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml> -
============ 4 passed, 3 skipped, 8 warnings in 2068.31s (0:34:28) =============

>>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221002-045227064454371
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:506dff284294105de6bdd24aa6f781f54e69e333f0d6869e000a2c09a77e1a35
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:bfa32b2c-be16-4382-84c7-a37b2640c373
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a0595861e68d78127a7a82f7d0509b41e6c401d1e16165217ef519e879af58ac
Deleted: sha256:ef6426807c64fb95152af12c51eac2b4496f36c08bea8978c932d2f134d67782
Deleted: sha256:30e1996a122308e6285971edd0e42260c2b50a6d390575539a1b39b6ac4ef082
Deleted: sha256:fbfd6cb005bf5ba9d11a8aa5dc20f36fda097d2170e46de7c2534dd4abc7a6b2
Deleted: sha256:5623bc42d55deba59077bfb8937037245fd3725d11fa5b33e4fcf73fca9a9d1e
Deleted: sha256:fd1daefaef42d04c521682e74fc725f088e69422ae0a6b63c0232139a642d3e8
Deleted: sha256:305b7ef9aaa704225b47e923af33659596806872350c2e9a20dd715310f7aae9
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:506dff284294105de6bdd24aa6f781f54e69e333f0d6869e000a2c09a77e1a35
  Associated tags:
 - 20221002-045227064454371
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221002-045227064454371
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221002-045227064454371].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:506dff284294105de6bdd24aa6f781f54e69e333f0d6869e000a2c09a77e1a35].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a0595861e68d78127a7a82f7d0509b41e6c401d1e16165217ef519e879af58ac
  Associated tags:
 - bfa32b2c-be16-4382-84c7-a37b2640c373
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:bfa32b2c-be16-4382-84c7-a37b2640c373].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a0595861e68d78127a7a82f7d0509b41e6c401d1e16165217ef519e879af58ac].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:56e68bbeaee120032ff59c188207a4a1194acef2dfeb6cf1072ea7abaf707dc7
  Associated tags:
 - e84b1fc8-c4b7-4388-aed2-f9dadc5093cc
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:e84b1fc8-c4b7-4388-aed2-f9dadc5093cc].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:56e68bbeaee120032ff59c188207a4a1194acef2dfeb6cf1072ea7abaf707dc7].
Removed the container

> Task :sdks:python:test-suites:dataflow:py37:validatesContainer

echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:faefebeff90985365590dbae4435abb57a7a7af6a4fcfec10cedf724e95b290e
  Associated tags:
 - 20221002-045227221964190
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221002-045227221964190
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221002-045227221964190].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:faefebeff90985365590dbae4435abb57a7a7af6a4fcfec10cedf724e95b290e].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:3fb5419e33d12130e1f77e85a89e4396fb311c2db9c6bc8b8bbd0ef4e76e0c62
  Associated tags:
 - 12e5cff2-94da-4419-8925-134f03e4f8bd
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:12e5cff2-94da-4419-8925-134f03e4f8bd].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:3fb5419e33d12130e1f77e85a89e4396fb311c2db9c6bc8b8bbd0ef4e76e0c62].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:072215bd7d4d16646784db8b97a9ca06048dbdf45a8142ebf7c48c8ad2c6805d
  Associated tags:
 - 7d44a9f3-f468-427f-9fa8-f574838c0779
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:7d44a9f3-f468-427f-9fa8-f574838c0779].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:072215bd7d4d16646784db8b97a9ca06048dbdf45a8142ebf7c48c8ad2c6805d].

> Task :sdks:python:test-suites:dataflow:py39:validatesContainer

[gw0] [100%] PASSED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it 

=================================== FAILURES ===================================
____ WordCountIT.test_wordcount_it_with_prebuilt_sdk_container_cloud_build _____
[gw0] linux -- Python 3.9.10 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/bin/python3.9>

self = <apache_beam.examples.wordcount_it_test.WordCountIT testMethod=test_wordcount_it_with_prebuilt_sdk_container_cloud_build>

    @pytest.mark.it_validatescontainer
    def test_wordcount_it_with_prebuilt_sdk_container_cloud_build(self):
>     self._run_wordcount_it(
          wordcount.run,
          experiment='beam_fn_api',
          prebuild_sdk_container_engine='cloud_build')

apache_beam/examples/wordcount_it_test.py:103: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/examples/wordcount_it_test.py:146: in _run_wordcount_it
    run_wordcount(
apache_beam/examples/wordcount.py:106: in run
    output | 'Write' >> WriteToText(known_args.output)
apache_beam/pipeline.py:597: in __exit__
    self.result = self.run()
apache_beam/pipeline.py:547: in run
    return Pipeline.from_runner_api(
apache_beam/pipeline.py:574: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/dataflow/test_dataflow_runner.py:66: in run_pipeline
    self.result.wait_until_finish(duration=wait_duration)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <DataflowPipelineResult <Job
 clientRequestId: '20221002050839500759-9986'
 createTime: '2022-10-02T05:08:43.019328Z'
...022-10-02T05:08:43.019328Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7f2dd933b0a0>
duration = None

    def wait_until_finish(self, duration=None):
      if not self.is_in_terminal_state():
        if not self.has_job:
          raise IOError('Failed to get the Dataflow job id.')
        consoleUrl = (
            "Console URL: https://console.cloud.google.com/"
            f"dataflow/jobs/<RegionId>/{self.job_id()}"
            "?project=<ProjectId>")
        thread = threading.Thread(
            target=DataflowRunner.poll_for_job_completion,
            args=(self._runner, self, duration))
    
        # Mark the thread as a daemon thread so a keyboard interrupt on the main
        # thread will terminate everything. This is also the reason we will not
        # use thread.join() to wait for the polling thread.
        thread.daemon = True
        thread.start()
        while thread.is_alive():
>         time.sleep(5.0)
E         Failed: Timeout >900.0s

apache_beam/runners/dataflow/dataflow_runner.py:1658: Failed
=============================== warnings summary ===============================
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py>:37: DeprecationWarning: Support for grpcio-gcp is deprecated. This feature will be
              removed from `google-api-core` after January 1, 2024. If you need to
              continue to use this feature, please pin to a specific version of
              `google-api-core`.
    warnings.warn(

../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/typehints/pandas_type_compatibility_test.py:66
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    }).set_index(pd.Int64Index(range(123, 223), name='an_index')),

apache_beam/typehints/pandas_type_compatibility_test.py:89
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    pd.Int64Index(range(123, 223), name='an_index'),

apache_beam/typehints/pandas_type_compatibility_test.py:90
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    pd.Int64Index(range(475, 575), name='another_index'),

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.9_sdk.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build
======= 1 failed, 3 passed, 3 skipped, 8 warnings in 2218.68s (0:36:58) ========
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221002-045227055807463
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:7d0965650dd9ec6556e8ec141273af9a7bf0f0877e60262f2d73db55f4fb418e
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:0792c749-d9e4-44fb-ab94-471377a13ff7
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:76f113a30c2e0316abc83ebc9d283ac40d701912a5270c77e9189d1455ac445e
Deleted: sha256:5480cdeec50323ff44305025195d061a1712ea8f185e6a46b1be27d63f49bb49
Deleted: sha256:afd669ebda3768c6ed98b7c5fc2030b046437478ea007658ac9fefbce6cf271a
Deleted: sha256:8d44983e7bdb3ef189c54d3fbf764ede5b4fd4e704b9529cad7f607aed6af344
Deleted: sha256:6832a7dc3995d084a530bbe2def6aef47c12f9c0a3ab01f4815201a52d7d782b
Deleted: sha256:c8515d86090eab154ce99c158ff37ee63608567dcde560d99525a10094e0c692
Deleted: sha256:5e6604cef8dea7764f6a719940bc7e33a129a89b2c8bd19b0139cbec93eb75bd
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:7d0965650dd9ec6556e8ec141273af9a7bf0f0877e60262f2d73db55f4fb418e
  Associated tags:
 - 20221002-045227055807463
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221002-045227055807463
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221002-045227055807463].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:7d0965650dd9ec6556e8ec141273af9a7bf0f0877e60262f2d73db55f4fb418e].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:76f113a30c2e0316abc83ebc9d283ac40d701912a5270c77e9189d1455ac445e
  Associated tags:
 - 0792c749-d9e4-44fb-ab94-471377a13ff7
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:0792c749-d9e4-44fb-ab94-471377a13ff7].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:76f113a30c2e0316abc83ebc9d283ac40d701912a5270c77e9189d1455ac445e].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:f9114f44a19651c084974681bbedb22dbc5ff7e5398eaed861fbf32e67fec6f2
  Associated tags:
 - eba84d11-3a84-43b8-ab7c-6e80513bedde
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:eba84d11-3a84-43b8-ab7c-6e80513bedde].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:f9114f44a19651c084974681bbedb22dbc5ff7e5398eaed861fbf32e67fec6f2].
Removed the container

> Task :sdks:python:test-suites:dataflow:py39:validatesContainer FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 359

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 51m 36s
51 actionable tasks: 41 executed, 4 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/qpwkqijaaadeg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Py_ValCont #9765

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9765/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org