You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/08/22 15:03:39 UTC
Build failed in Jenkins: beam_PostCommit_Py_ValCont_with_RC #518
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/518/display/redirect>
Changes:
------------------------------------------
[...truncated 2.80 MB...]
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7f4c9523c350>
duration = None
def wait_until_finish(self, duration=None):
if not self.is_in_terminal_state():
if not self.has_job:
raise IOError('Failed to get the Dataflow job id.')
consoleUrl = (
"Console URL: https://console.cloud.google.com/"
f"dataflow/jobs/<RegionId>/{self.job_id()}"
"?project=<ProjectId>")
thread = threading.Thread(
target=DataflowRunner.poll_for_job_completion,
args=(self._runner, self, duration))
# Mark the thread as a daemon thread so a keyboard interrupt on the main
# thread will terminate everything. This is also the reason we will not
# use thread.join() to wait for the polling thread.
thread.daemon = True
thread.start()
while thread.is_alive():
time.sleep(5.0)
# TODO: Merge the termination code in poll_for_job_completion and
# is_in_terminal_state.
terminated = self.is_in_terminal_state()
assert duration or terminated, (
'Job did not reach to a terminal state after waiting indefinitely. '
'{}'.format(consoleUrl))
if terminated and self.state != PipelineState.DONE:
# TODO(BEAM-1290): Consider converting this to an error log based on
# theresolution of the issue.
_LOGGER.error(consoleUrl)
> raise DataflowRuntimeException(
'Dataflow pipeline failed. State: %s, Error:\n%s' %
(self.state, getattr(self._runner, 'last_error_msg', None)),
E apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
E Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1 not found: manifest unknown: Failed to fetch "51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request "/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image..
apache_beam/runners/dataflow/dataflow_runner.py:765: DataflowRuntimeException
----------------------------- Captured stdout call -----------------------------
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-08-22_07_39_32-3840696519862004965?project=apache-beam-testing
------------------------------ Captured log call -------------------------------
INFO apache_beam.runners.portability.stager:stager.py:322 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
INFO apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:239 Compressed source files for building sdk container at /tmp/tmpmwlpvmwg/source.tgz
INFO apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:313 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/source-51165497-dc8f-49f3-b2a5-2a7839ceb1d1.tgz...
INFO apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:332 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/source-51165497-dc8f-49f3-b2a5-2a7839ceb1d1.tgz.
INFO apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:281 Building sdk container with Google Cloud Build, this may take a few minutes, you may check build log at https://console.cloud.google.com/cloud-build/builds/29893a1b-4036-4aa4-a6d1-31a4387450c9?project=844138762903
INFO apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:303 Python SDK container pre-build finished in 171.14 seconds
INFO apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:306 Python SDK container built and pushed as us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1.
INFO root:environments.py:313 Using provided Python SDK container image: us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
INFO root:environments.py:320 Python SDK container image set to "us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f4cc5a727a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f4cc5a73060> ====================
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/pipeline.pb...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/pipeline.pb in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:843 Create job: <Job
clientRequestId: '20230822143932376328-9986'
createTime: '2023-08-22T14:39:33.315735Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2023-08-22_07_39_32-3840696519862004965'
location: 'us-central1'
name: 'beamapp-jenkins-0822143932-375278-zmwbf9ko'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2023-08-22T14:39:33.315735Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:845 Created job with id: [2023-08-22_07_39_32-3840696519862004965]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:846 Submitted job: 2023-08-22_07_39_32-3840696519862004965
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:847 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-08-22_07_39_32-3840696519862004965?project=apache-beam-testing
INFO apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58 Console log:
INFO apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59 https://console.cloud.google.com/dataflow/jobs/us-central1/2023-08-22_07_39_32-3840696519862004965?project=apache-beam-testing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-08-22_07_39_32-3840696519862004965 is in state JOB_STATE_RUNNING
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:39:36.293Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-b.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:39:38.518Z: JOB_MESSAGE_BASIC: Executing operation Read/Read/Impulse+Read/Read/Map(<lambda at iobase.py:911>)+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/PairWithRestriction+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/SplitWithSizing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:39:38.535Z: JOB_MESSAGE_BASIC: Executing operation Write/Write/WriteImpl/DoOnce/Impulse+Write/Write/WriteImpl/DoOnce/FlatMap(<lambda at core.py:3736>)+Write/Write/WriteImpl/DoOnce/Map(decode)+Write/Write/WriteImpl/InitializeWrite
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:39:38.571Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:39:46.746Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:41:30.575Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1 not found: manifest unknown: Failed to fetch "51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request "/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:42:48.449Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1 not found: manifest unknown: Failed to fetch "51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request "/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:44:04.812Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1 not found: manifest unknown: Failed to fetch "51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request "/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:45:22.531Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1 not found: manifest unknown: Failed to fetch "51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request "/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:46:51.037Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1 not found: manifest unknown: Failed to fetch "51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request "/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-08-22T14:46:51.057Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1 not found: manifest unknown: Failed to fetch "51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request "/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image..
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:46:51.177Z: JOB_MESSAGE_WARNING: Unable to delete temp files: "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/dax-tmp-2023-08-22_07_39_32-3840696519862004965-S04-0-9cb94bca001afb0/tmp-9cb94bca001a0f5@DAX.sdfmeta."
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:46:51.181Z: JOB_MESSAGE_WARNING: Unable to delete temp files: "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/dax-tmp-2023-08-22_07_39_32-3840696519862004965-S01-1-70e1921d325985cb/tmp-70e1921d32598b54@DAX.recordio."
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:46:51.183Z: JOB_MESSAGE_WARNING: Unable to delete temp files: "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/dax-tmp-2023-08-22_07_39_32-3840696519862004965-S01-0-ef85f10cb0210506/tmp-ef85f10cb02107ff@DAX.recordio."
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:46:51.200Z: JOB_MESSAGE_WARNING: S04:Read/Read/Impulse+Read/Read/Map(<lambda at iobase.py:911>)+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/PairWithRestriction+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/SplitWithSizing failed.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206 2023-08-22T14:46:51.221Z: JOB_MESSAGE_WARNING: S01:Write/Write/WriteImpl/DoOnce/Impulse+Write/Write/WriteImpl/DoOnce/FlatMap(<lambda at core.py:3736>)+Write/Write/WriteImpl/DoOnce/Map(decode)+Write/Write/WriteImpl/InitializeWrite failed.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:46:51.231Z: JOB_MESSAGE_BASIC: Finished operation Read/Read/Impulse+Read/Read/Map(<lambda at iobase.py:911>)+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/PairWithRestriction+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/SplitWithSizing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:46:51.249Z: JOB_MESSAGE_BASIC: Finished operation Write/Write/WriteImpl/DoOnce/Impulse+Write/Write/WriteImpl/DoOnce/FlatMap(<lambda at core.py:3736>)+Write/Write/WriteImpl/DoOnce/Map(decode)+Write/Write/WriteImpl/InitializeWrite
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:46:51.361Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-08-22T14:49:08.560Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-08-22_07_39_32-3840696519862004965 is in state JOB_STATE_FAILED
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:764 Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-08-22_07_39_32-3840696519862004965?project=<ProjectId>
=============================== warnings summary ===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 40 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 32 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/pytest-beam_python3.11_sdk.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1 not found: manifest unknown: Failed to fetch "51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request "/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image..
====== 1 failed, 3 passed, 16 skipped, 91 warnings in 2024.58s (0:33:44) =======
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230822-142654044225678
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:8ceb19cbcca4958a0dd078df7bf8ff58e0428382ca2cfd3e0bb300da6cd81622
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:e0a01cc4-4209-4565-a24f-9989c41d9c11
Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:0dbc9643e61ee76c9ab8a12ac76e7057c3b30d3fd2e64709895654bce26005e0
Deleted: sha256:e95d237889a10c2a8d5f88a6abf0d6480035bec479b2fc9c3512c53391137292
Deleted: sha256:0c21d02bddf9845264ec89c5353cc194f4b596ad421ebb8ac432f3cd71bcb0ec
Deleted: sha256:88dffd2ef1819b3f2785339047edac1c84cdfc0562bf4ed403e335764f2255fa
Deleted: sha256:c32cb64a611f100a2874bff53652bc6fc9e5dff5552a7cc9b565f96852b50c80
Deleted: sha256:e2e99ef1bff065e6b412f085ca0d09e8185cd7a7e6d86707cb9de52779096c5c
Deleted: sha256:d833bcc63725299032db37c2707fc28cdfcac9f9e7a83ff1c5768cc77d785c6e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:8ceb19cbcca4958a0dd078df7bf8ff58e0428382ca2cfd3e0bb300da6cd81622
Associated tags:
- 20230822-142654044225678
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230822-142654044225678
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230822-142654044225678].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:8ceb19cbcca4958a0dd078df7bf8ff58e0428382ca2cfd3e0bb300da6cd81622].
Digests:
- us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:0dbc9643e61ee76c9ab8a12ac76e7057c3b30d3fd2e64709895654bce26005e0
Associated tags:
- e0a01cc4-4209-4565-a24f-9989c41d9c11
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:e0a01cc4-4209-4565-a24f-9989c41d9c11].
Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:0dbc9643e61ee76c9ab8a12ac76e7057c3b30d3fd2e64709895654bce26005e0].
Removed the container
> Task :sdks:python:test-suites:dataflow:py311:validatesContainer FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 351
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 351
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py310:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 351
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 50m 3s
66 actionable tasks: 55 executed, 4 from cache, 7 up-to-date
Publishing build scan...
https://ge.apache.org/s/aazn5t4evkmtg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Py_ValCont_with_RC #519
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/519/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org