You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/08 20:24:34 UTC

Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2452

See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2452/display/redirect?page=changes>

Changes:

[suztomo] [BEAM-11205] Upgrading the Libraries BOM to v22

[randomstep] [BEAM-12708] Bump arrow-memory-netty

[Etienne Chauchot] [BEAM-12153] implement GroupByKey with CombinePerKey with Concatenate

[Etienne Chauchot] [BEAM-11023] Increase memory in SS Validates runner tests to avoid OOM

[vincent.marquez] [BEAM-9008] adds CassandraIO.readAll

[Etienne Chauchot] [BEAM-12727] extract Concatenate CombineFn to runner-core module to


------------------------------------------
[...truncated 1.11 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:01:26.790Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:01:26.821Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:01:41.165Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:01:41.199Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:01:55.569Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:01:55.602Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:02:12.503Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:02:12.549Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:02:26.517Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:02:26.549Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:02:39.427Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:02:39.509Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:02:54.193Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:02:54.223Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:03:08.290Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:03:08.326Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:03:22.238Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:03:22.267Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:03:36.396Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:03:36.433Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:03:50.086Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:03:50.117Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:04:04.206Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:04:04.250Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:04:18.146Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:04:18.204Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:04:32.379Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:04:32.481Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:04:46.729Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:04:46.766Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:00.089Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:00.137Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:14.427Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:14.462Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:28.598Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:28.639Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:42.793Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:42.839Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:57.213Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:05:57.256Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:06:10.553Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:06:10.588Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:06:24.287Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:06:24.321Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:06:38.281Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:06:38.328Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:06:53.080Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:06:53.111Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:07:06.324Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:07:06.421Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:07:20.463Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:07:20.492Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:07:34.454Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:07:34.482Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:07:48.967Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:07:49.044Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:02.611Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:02.652Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:16.748Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:16.768Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:30.618Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:30.712Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:45.389Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:45.429Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:59.324Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:08:59.361Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:09:13.998Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:09:14.031Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:09:28.733Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:09:28.777Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:09:42.568Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:09:42.602Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:09:57.862Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:09:57.896Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:10:11.803Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:10:11.835Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:10:26.140Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:10:26.173Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:10:40.831Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:10:40.887Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:10:55.626Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:10:55.654Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:11:10.563Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:11:10.589Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:11:25.589Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:11:25.612Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:11:41.009Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:11:41.049Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:11:55.813Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:11:55.859Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:12:10.259Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:12:10.286Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:12:24.047Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:12:24.091Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:12:37.019Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:12:37.048Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:12:51.033Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:12:51.070Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:13:05.783Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:13:05.817Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:13:18.826Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:13:18.892Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:13:33.012Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:13:33.078Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:13:47.153Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:13:47.181Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:02.187Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:02.212Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:16.654Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:16.682Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:30.669Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:30.700Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:44.415Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:44.436Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:58.719Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:14:58.738Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:15:13.057Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:15:13.087Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:15:26.829Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:15:26.858Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:15:42.022Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:15:42.095Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:15:58.034Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:15:58.065Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:16:12.092Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:16:12.131Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:16:27.918Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:16:27.942Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:16:41.332Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:16:41.350Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:16:55.398Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:16:55.448Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:17:09.651Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:17:09.678Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:17:23.155Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:17:23.184Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:17:37.096Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:17:37.127Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:17:51.201Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:17:51.228Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:18:06.223Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:18:06.249Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:18:19.818Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:18:19.845Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:18:34.077Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:18:34.106Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:18:48.848Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:18:48.880Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:19:03.838Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:19:03.914Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:19:17.921Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:19:17.952Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:19:33.589Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:19:33.609Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:19:48.177Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:19:48.236Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:20:02.168Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:20:02.217Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:20:17.414Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:20:17.463Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:20:32.889Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:20:32.915Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:20:46.652Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:20:46.682Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:00.910Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:00.930Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:14.481Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:14.505Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:30.170Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:30.213Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:43.806Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:43.840Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:58.568Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:21:58.630Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:22:12.916Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:22:12.957Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:22:26.976Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:22:27.002Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:22:41.338Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:22:41.366Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:22:55.349Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:22:55.378Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:23:09.944Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:23:09.974Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:23:25.148Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:23:25.177Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:23:42.824Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-08T20:23:42.851Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-08_12_09_20-13078851421234859752 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 17 failed, 14 passed, 1 skipped, 8 warnings in 5371.10 seconds ========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 23m 58s
84 actionable tasks: 75 executed, 9 from cache

Publishing build scan...
https://gradle.com/s/nbbejpmmto3ho

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Py_VR_Dataflow_V2 #2473

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2473/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2472

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2472/display/redirect?page=changes>

Changes:

[rohde.samuel] [BEAM-12842] Add timestamp to test work item to deflake

[suztomo] [BEAM-12873] HL7v2IO: to leave schematizedData null, not empty


------------------------------------------
[...truncated 1.99 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:32:54.684Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:32:54.786Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:07.433Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:07.474Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:19.549Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:19.575Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:32.105Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:32.129Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:44.666Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:44.692Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:57.208Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:33:57.229Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:10.080Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:10.108Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:22.079Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:22.099Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:34.096Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:34.127Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:46.165Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:46.193Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:58.456Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:34:58.492Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:35:11.252Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:35:11.279Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:35:23.616Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:35:23.644Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:35:35.838Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:35:35.872Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:35:48.344Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:35:48.363Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:00.329Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:00.352Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:13.497Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:13.523Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:25.414Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:25.434Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:38.026Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:38.063Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:50.411Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:36:50.436Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:02.421Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:02.449Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:15.304Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:15.321Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:27.782Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:27.809Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:41.015Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:41.046Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:53.626Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:37:53.655Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:06.578Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:06.603Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:19.098Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:19.120Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:30.978Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:31.008Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:43.688Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:43.720Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:55.516Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:38:55.553Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:07.840Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:07.868Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:19.862Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:19.885Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:32.546Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:32.581Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:44.923Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:44.947Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:57.523Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:39:57.581Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:40:10.191Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:40:10.210Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:40:22.857Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:40:22.876Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:40:35.179Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:40:35.206Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:40:47.902Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:40:47.922Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:00.320Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:00.346Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:12.954Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:12.984Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:25.191Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:25.221Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:38.067Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:38.087Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:50.478Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:41:50.506Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:02.934Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:02.951Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:15.312Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:15.339Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:27.265Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:27.295Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:39.874Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:39.906Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:52.906Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:42:52.944Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:05.145Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:05.162Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:17.469Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:17.487Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:30.461Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:30.479Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:43.132Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:43.154Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:55.749Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:43:55.787Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:08.358Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:08.381Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:21.226Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:21.248Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:33.863Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:33.879Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:46.348Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:46.374Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:59.153Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:44:59.180Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:45:11.683Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:45:11.705Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:45:24.440Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:45:24.466Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:45:36.753Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:45:36.776Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:45:49.729Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:45:49.775Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:01.934Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:01.960Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:14.296Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:14.323Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:26.141Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:26.174Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:37.997Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:38.026Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:50.460Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:46:50.486Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:02.617Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:02.644Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:15.057Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:15.079Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:27.448Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:27.473Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:39.948Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:39.971Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:52.252Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:47:52.277Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:05.011Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:05.033Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:17.421Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:17.447Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:30.092Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:30.123Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:42.370Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:42.388Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:54.673Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:48:54.700Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:07.331Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:07.356Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:19.358Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:19.392Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:31.211Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:31.239Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:43.839Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:43.864Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:56.622Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:49:56.647Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:08.624Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:08.649Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:20.882Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:20.915Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:34.204Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:34.234Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:47.252Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:47.274Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:59.935Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:50:59.959Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:12.398Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:12.425Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:24.750Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:24.778Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:37.383Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:37.412Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:45.994Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2021-09-13_12_36_53-4438769770964037963.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:46.038Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:46.080Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:46.107Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:46.135Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-13T20:51:46.161Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-13_12_36_53-4438769770964037963 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 26 failed, 5 passed, 1 skipped, 8 warnings in 9133.51 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 51m 45s
84 actionable tasks: 55 executed, 29 from cache

Publishing build scan...
https://gradle.com/s/7i7t7mswz3orc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2471

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2471/display/redirect>

Changes:


------------------------------------------
[...truncated 732.36 KB...]
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/requirements.txt...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/dataflow-worker.jar in 4 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120820-762775.1631534900.763035/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210913120820764981-6630'
                                                                           createTime: '2021-09-13T12:08:28.380125Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-13_05_08_27-2748646450633396796'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0913120820-762775'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-13T12:08:28.380125Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-13_05_08_27-2748646450633396796]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-13_05_08_27-2748646450633396796
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-13_05_08_27-2748646450633396796?project=apache-beam-testing
WARNING  apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:64 Waiting indefinitely for streaming job.
______________ ReshuffleTest.test_reshuffle_preserves_timestamps _______________
[gw5] linux -- Python 3.8.5 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8>

self = <apache_beam.transforms.util_test.ReshuffleTest testMethod=test_reshuffle_preserves_timestamps>

    @pytest.mark.it_validatesrunner
    def test_reshuffle_preserves_timestamps(self):
      with TestPipeline() as pipeline:
    
        # Create a PCollection and assign each element with a different timestamp.
        before_reshuffle = (
            pipeline
            | beam.Create([
                {
                    'name': 'foo', 'timestamp': MIN_TIMESTAMP
                },
                {
                    'name': 'foo', 'timestamp': 0
                },
                {
                    'name': 'bar', 'timestamp': 33
                },
                {
                    'name': 'bar', 'timestamp': 0
                },
            ])
            | beam.Map(
                lambda element: beam.window.TimestampedValue(
                    element, element['timestamp'])))
    
        # Reshuffle the PCollection above and assign the timestamp of an element
        # to that element again.
        after_reshuffle = before_reshuffle | beam.Reshuffle()
    
        # Given an element, emits a string which contains the timestamp and the
        # name field of the element.
        def format_with_timestamp(element, timestamp=beam.DoFn.TimestampParam):
          t = str(timestamp)
          if timestamp == MIN_TIMESTAMP:
            t = 'MIN_TIMESTAMP'
          elif timestamp == MAX_TIMESTAMP:
            t = 'MAX_TIMESTAMP'
          return '{} - {}'.format(t, element['name'])
    
        # Combine each element in before_reshuffle with its timestamp.
        formatted_before_reshuffle = (
            before_reshuffle
            | "Get before_reshuffle timestamp" >> beam.Map(format_with_timestamp))
    
        # Combine each element in after_reshuffle with its timestamp.
        formatted_after_reshuffle = (
            after_reshuffle
            | "Get after_reshuffle timestamp" >> beam.Map(format_with_timestamp))
    
        expected_data = [
            'MIN_TIMESTAMP - foo',
            'Timestamp(0) - foo',
            'Timestamp(33) - bar',
            'Timestamp(0) - bar'
        ]
    
        # Can't compare formatted_before_reshuffle and formatted_after_reshuffle
        # directly, because they are deferred PCollections while equal_to only
        # takes a concrete argument.
        assert_that(
            formatted_before_reshuffle,
            equal_to(expected_data),
            label="formatted_before_reshuffle")
>       assert_that(
            formatted_after_reshuffle,
            equal_to(expected_data),
            label="formatted_after_reshuffle")

apache_beam/transforms/util_test.py:611: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:587: in __exit__
    self.result = self.run()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <apache_beam.testing.test_pipeline.TestPipeline object at 0x7fe3a43a35e0>
test_runner_api = True

    def run(self, test_runner_api=True):
      result = super(TestPipeline, self).run(
          test_runner_api=(
              False if self.not_use_test_runner_api else test_runner_api))
      if self.blocking:
        state = result.wait_until_finish()
>       assert state in (PipelineState.DONE, PipelineState.CANCELLED), \
            "Pipeline execution failed."
E       AssertionError: Pipeline execution failed.
E       assert 'FAILED' in ('DONE', 'CANCELLED')

apache_beam/testing/test_pipeline.py:117: AssertionError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/requirements.txt...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/dataflow-worker.jar in 4 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0913120821-263683.1631534901.263954/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210913120821265789-3554'
                                                                           createTime: '2021-09-13T12:08:28.872961Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-13_05_08_27-4143476643428037423'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0913120821-263683'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-13T12:08:28.872961Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-13_05_08_27-4143476643428037423]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-13_05_08_27-4143476643428037423
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-13_05_08_27-4143476643428037423?project=apache-beam-testing
WARNING  apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:64 Waiting indefinitely for streaming job.
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
========= 28 failed, 3 passed, 1 skipped, 8 warnings in 137.61 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 14s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/mze2ic5qewcwq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2470

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2470/display/redirect>

Changes:


------------------------------------------
[...truncated 30.09 KB...]
Collecting distlib==0.3.1
  Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB)
Collecting toml>=0.9.4
  Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting six>=1.14.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting py>=1.4.17
  Using cached py-1.10.0-py2.py3-none-any.whl (97 kB)
Collecting packaging>=14
  Using cached packaging-21.0-py3-none-any.whl (40 kB)
Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
  Using cached virtualenv-20.7.2-py2.py3-none-any.whl (5.3 MB)
Collecting pluggy>=0.12.0
  Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting filelock>=3.0.0
  Using cached filelock-3.0.12-py3-none-any.whl (7.6 kB)
Collecting grpcio>=1.37.0
  Using cached grpcio-1.40.0-cp38-cp38-manylinux2014_x86_64.whl (4.3 MB)
Collecting protobuf<4.0dev,>=3.5.0.post1
  Using cached protobuf-3.17.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from grpcio-tools==1.37.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build-requirements.txt> (line 17)) (58.0.4)

> Task :sdks:java:core:shadowJar FROM-CACHE

> Task :sdks:python:test-suites:dataflow:py38:setupVirtualenv
  Downloading https://files.pythonhosted.org/packages/b8/31/f3c2ed2f3b09adff67b40823eb15da4461e98b5015a519bf6fbb93ad678d/grpcio-1.40.0-cp38-cp38-manylinux2010_x86_64.whl (4.2MB)
Requirement already satisfied, skipping upgrade: setuptools in <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from grpcio-tools==1.37.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build-requirements.txt> (line 17)) (58.0.4)
Collecting platformdirs<3,>=2 (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox==3.20.1)
  Using cached https://files.pythonhosted.org/packages/15/4d/23989bdcb80a095a4b92a54a1f568e95bfc9793c70707be623dc75c11257/platformdirs-2.3.0-py3-none-any.whl
Collecting backports.entry-points-selectable>=1.0.4 (from virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox==3.20.1)
  Using cached https://files.pythonhosted.org/packages/0c/cd/1e156227cad9f599524eb10af62a2362f872910a49402dbd2bea2dedc91c/backports.entry_points_selectable-1.1.0-py2.py3-none-any.whl
Collecting pyparsing>=2.0.2 (from packaging>=14->tox==3.20.1)
  Using cached https://files.pythonhosted.org/packages/8a/bb/488841f56197b13700afd5658fc279a2025a39e22449b7cf29864669b15d/pyparsing-2.4.7-py2.py3-none-any.whl
Installing collected packages: distlib, platformdirs, six, backports.entry-points-selectable, filelock, virtualenv, toml, pluggy, py, pyparsing, packaging, tox, protobuf, grpcio, grpcio-tools, future, mypy-protobuf

> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE

> Task :sdks:python:setupVirtualenv
Collecting pyparsing>=2.0.2
  Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting platformdirs<3,>=2
  Using cached platformdirs-2.3.0-py3-none-any.whl (13 kB)
Collecting backports.entry-points-selectable>=1.0.4
  Using cached backports.entry_points_selectable-1.1.0-py2.py3-none-any.whl (6.2 kB)
Installing collected packages: six, pyparsing, platformdirs, filelock, distlib, backports.entry-points-selectable, virtualenv, toml, py, protobuf, pluggy, packaging, grpcio, tox, mypy-protobuf, grpcio-tools, future

> Task :sdks:java:extensions:arrow:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:jar
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar

> Task :sdks:python:test-suites:dataflow:py38:setupVirtualenv
Successfully installed backports.entry-points-selectable-1.1.0 distlib-0.3.1 filelock-3.0.12 future-0.18.2 grpcio-1.40.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.0 platformdirs-2.3.0 pluggy-1.0.0 protobuf-3.17.3 py-1.10.0 pyparsing-2.4.7 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.7.2
You are using pip version 19.0.3, however version 21.2.4 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

> Task :sdks:java:fn-execution:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar

> Task :sdks:python:setupVirtualenv
Successfully installed backports.entry-points-selectable-1.1.0 distlib-0.3.1 filelock-3.0.12 future-0.18.2 grpcio-1.40.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.0 platformdirs-2.3.0 pluggy-1.0.0 protobuf-3.17.3 py-1.10.0 pyparsing-2.4.7 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.7.2

> Task :sdks:java:harness:shadowJar FROM-CACHE

> Task :sdks:python:sdist
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:487: UserWarning: Normalizing '2.34.0.dev' to '2.34.0.dev0'
  warnings.warn(tmpl.format(**locals()))
INFO:gen_protos:Regenerating Python proto definitions (no output files).
INFO:gen_protos:Found protoc_gen_mypy at <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/1922375555/bin/protoc-gen-mypy>
beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused.
Writing mypy to external_transforms_pb2.pyi
Writing mypy to beam_runner_api_pb2.pyi
Writing mypy to standard_window_fns_pb2.pyi
Writing mypy to metrics_pb2.pyi
Writing mypy to endpoints_pb2.pyi
Writing mypy to schema_pb2.pyi
Writing mypy to beam_artifact_api_pb2.pyi
Writing mypy to beam_expansion_api_pb2.pyi
Writing mypy to beam_job_api_pb2.pyi
Writing mypy to beam_provision_api_pb2.pyi
Writing mypy to beam_fn_api_pb2.pyi
Writing mypy to beam_interactive_api_pb2.pyi
RefactoringTool: Skipping optional fixer: idioms
RefactoringTool: Skipping optional fixer: ws_comma
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py>
RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py>
RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py>
RefactoringTool: Files that were modified:
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2_urns.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py>
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md


> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :runners:google-cloud-dataflow-java:worker:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:worker:classes
> Task :runners:google-cloud-dataflow-java:worker:shadowJar FROM-CACHE

> Task :sdks:python:test-suites:dataflow:py38:installGcpTest
Processing <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz>
Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/5a/80/acd1455bea0a9fcdc60a748a97dcbb3ff624726fb90987a0fc1c19e7a5a5/avro-python3-1.9.2.1.tar.gz
Collecting crcmod<2.0,>=1.7 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/6b/b0/e595ce2a2527e169c3bcd6c33d2473c1918e0b7f6826a043ca1245dd4e5b/crcmod-1.7.tar.gz
Collecting dill<0.3.2,>=0.3.1.1 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/c7/11/345f3173809cea7f1a193bfbf02403fff250a3360e0e118a1630985e547d/dill-0.3.1.1.tar.gz
Collecting fastavro<2,>=0.21.4 (from apache-beam==2.34.0.dev0)
  Downloading https://files.pythonhosted.org/packages/6c/ce/4856f2e70cef8c9d0293bf087dd5fc1453fcb3a07040444e7e05e34c18ea/fastavro-1.4.4.tar.gz (726kB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from apache-beam==2.34.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.29.0 in <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from apache-beam==2.34.0.dev0) (1.40.0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/08/f7/4c3fad73123a24d7394b6f40d1ec9c1cbf2e921cfea1797216ffd0a51fb1/hdfs-2.6.0-py3-none-any.whl
Collecting httplib2<0.20.0,>=0.8 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/15/dc/d14bce03f4bfd0214b90a3f556d7c96f75bb94ad597c816a641b962f22e9/httplib2-0.19.1-py3-none-any.whl
Collecting numpy<1.21.0,>=1.14.3 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/a3/9d/5cc11fb882e628d21f8d490f56610f2e6612c9f55ecb25b2b57d4729c5bc/numpy-1.20.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Collecting pymongo<4.0.0,>=3.8.0 (from apache-beam==2.34.0.dev0)
  Downloading https://files.pythonhosted.org/packages/ba/3a/ea837307e36f8d182341b2cb21196b777f19681473040188cf9299721623/pymongo-3.12.0-cp38-cp38-manylinux1_x86_64.whl (524kB)
Collecting oauth2client<5,>=2.0.1 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/95/a9/4f25a14d23f0786b64875b91784607c2277eff25d48f915e39ff0cff505a/oauth2client-4.1.3-py2.py3-none-any.whl
Requirement already satisfied: protobuf<4,>=3.12.2 in <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages> (from apache-beam==2.34.0.dev0) (3.17.3)
Collecting pyarrow<5.0.0,>=0.15.1 (from apache-beam==2.34.0.dev0)
  Downloading https://files.pythonhosted.org/packages/2a/c8/2e7db2a477279efd7bce5dbb1f54d8ac16395fc013e34262517ff13a9c0e/pyarrow-4.0.1-cp38-cp38-manylinux2010_x86_64.whl (21.0MB)
Collecting pydot<2,>=1.2.0 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/ea/76/75b1bb82e9bad3e3d656556eaa353d8cd17c4254393b08ec9786ac8ed273/pydot-1.4.2-py2.py3-none-any.whl
Collecting python-dateutil<3,>=2.8.0 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/36/7a/87837f39d0296e723bb9b62bbb257d0355c7f6128853c78955f57342a56d/python_dateutil-2.8.2-py2.py3-none-any.whl
Collecting pytz>=2018.3 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/70/94/784178ca5dd892a98f113cdd923372024dc04b8d40abe77ca76b5fb90ca6/pytz-2021.1-py2.py3-none-any.whl
Collecting requests<3.0.0,>=2.24.0 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/92/96/144f70b972a9c0eabbd4391ef93ccd49d0f2747f4f6a2a2738e99e5adc65/requests-2.26.0-py2.py3-none-any.whl
Collecting typing-extensions<4,>=3.7.0 (from apache-beam==2.34.0.dev0)
  Using cached https://files.pythonhosted.org/packages/74/60/18783336cc7fcdd95dae91d73477830aa53f5d3181ae4fe20491d7fc3199/typing_extensions-3.10.0.2-py3-none-any.whl
Collecting orjson<4.0 (from apache-beam==2.34.0.dev0)
  Downloading https://files.pythonhosted.org/packages/75/cd/eac8908d0b4a4b08067bc68c04e52d7601b0ed86bf2a6a3264c46dd51a84/orjson-3.6.3.tar.gz (548kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'error'
    Complete output from command <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8> <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py> prepare_metadata_for_build_wheel /tmp/tmpf96kxelg:
    
    Cargo, the Rust package manager, is not installed or is not on PATH.
    This package requires Rust and Cargo to compile extensions. Install it through
    the system's package manager or via https://rustup.rs/
    
    Checking for Rust toolchain....
    
    ----------------------------------------
Command "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8> <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py> prepare_metadata_for_build_wheel /tmp/tmpf96kxelg" failed with error code 1 in /tmp/pip-install-4tsemwmg/orjson
You are using pip version 19.0.3, however version 21.2.4 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

> Task :sdks:python:test-suites:dataflow:py38:installGcpTest FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1m 42s
82 actionable tasks: 52 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/b4yya7jkd6tmm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


beam_PostCommit_Py_VR_Dataflow_V2 - Build # 2469 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Py_VR_Dataflow_V2 - Build # 2469 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2469/ to view the results.

Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2468

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2468/display/redirect>

Changes:


------------------------------------------
[...truncated 1.82 MB...]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-12_12_22_09-488273294200315288
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_12_22_09-488273294200315288?project=apache-beam-testing
WARNING  apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:64 Waiting indefinitely for streaming job.
___________________ SideInputsTest.test_flattened_side_input ___________________
[gw7] linux -- Python 3.8.5 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8>

self = <apache_beam.transforms.sideinputs_test.SideInputsTest testMethod=test_flattened_side_input>

    @pytest.mark.it_validatesrunner
    def test_flattened_side_input(self):
      pipeline = self.create_pipeline()
      main_input = pipeline | 'main input' >> beam.Create([None])
      side_input = (
          pipeline | 'side1' >> beam.Create(['a']),
          pipeline | 'side2' >> beam.Create(['b'])) | beam.Flatten()
      results = main_input | beam.FlatMap(
          lambda _, ab: ab, beam.pvalue.AsList(side_input))
    
      assert_that(results, equal_to(['a', 'b']))
>     pipeline.run()

apache_beam/transforms/sideinputs_test.py:365: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <apache_beam.testing.test_pipeline.TestPipeline object at 0x7eff27a94d60>
test_runner_api = True

    def run(self, test_runner_api=True):
      result = super(TestPipeline, self).run(
          test_runner_api=(
              False if self.not_use_test_runner_api else test_runner_api))
      if self.blocking:
        state = result.wait_until_finish()
>       assert state in (PipelineState.DONE, PipelineState.CANCELLED), \
            "Pipeline execution failed."
E       AssertionError: Pipeline execution failed.
E       assert 'FAILED' in ('DONE', 'CANCELLED')

apache_beam/testing/test_pipeline.py:117: AssertionError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/requirements.txt...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/dataflow-worker.jar in 4 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192212-315846.1631474532.315997/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210912192212317111-3036'
                                                                           createTime: '2021-09-12T19:22:19.676659Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-12_12_22_18-1814917123935003537'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0912192212-315846'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-12T19:22:19.676659Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-12_12_22_18-1814917123935003537]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-12_12_22_18-1814917123935003537
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_12_22_18-1814917123935003537?project=apache-beam-testing
WARNING  apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:64 Waiting indefinitely for streaming job.
__________________ SideInputsTest.test_reiterable_side_input ___________________
[gw6] linux -- Python 3.8.5 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8>

self = <apache_beam.transforms.sideinputs_test.SideInputsTest testMethod=test_reiterable_side_input>

    @pytest.mark.it_validatesrunner
    def test_reiterable_side_input(self):
      expected_side = frozenset(range(100))
    
      def check_reiteration(main, side):
        assert expected_side == set(side), side
        # Iterate a second time.
        assert expected_side == set(side), side
        # Iterate over two copies of the input at the same time.
        both = zip(side, side)
        first, second = zip(*both)
        assert expected_side == set(first), first
        assert expected_side == set(second), second
        # This will iterate over two copies of the side input, but offset.
        offset = [None] * (len(expected_side) // 2)
        both = zip(itertools.chain(side, offset), itertools.chain(offset, side))
        first, second = zip(*both)
        expected_and_none = frozenset.union(expected_side, [None])
        assert expected_and_none == set(first), first
        assert expected_and_none == set(second), second
    
      pipeline = self.create_pipeline()
      pcol = pipeline | 'start' >> beam.Create(['A', 'B'])
      side = pipeline | 'side' >> beam.Create(expected_side)
      _ = pcol | 'check' >> beam.Map(check_reiteration, beam.pvalue.AsIter(side))
>     pipeline.run()

apache_beam/transforms/sideinputs_test.py:220: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <apache_beam.testing.test_pipeline.TestPipeline object at 0x7f657b42f220>
test_runner_api = True

    def run(self, test_runner_api=True):
      result = super(TestPipeline, self).run(
          test_runner_api=(
              False if self.not_use_test_runner_api else test_runner_api))
      if self.blocking:
        state = result.wait_until_finish()
>       assert state in (PipelineState.DONE, PipelineState.CANCELLED), \
            "Pipeline execution failed."
E       AssertionError: Pipeline execution failed.
E       assert 'FAILED' in ('DONE', 'CANCELLED')

apache_beam/testing/test_pipeline.py:117: AssertionError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/requirements.txt...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/dataflow-worker.jar in 3 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912192218-505644.1631474538.505800/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210912192218507005-3036'
                                                                           createTime: '2021-09-12T19:22:25.187147Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-12_12_22_24-9347583160658835523'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0912192218-505644'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-12T19:22:25.187147Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-12_12_22_24-9347583160658835523]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-12_12_22_24-9347583160658835523
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_12_22_24-9347583160658835523?project=apache-beam-testing
WARNING  apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:64 Waiting indefinitely for streaming job.
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 27 failed, 4 passed, 1 skipped, 8 warnings in 4638.48 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 22m 11s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/wqaalixodt7x4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2467

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2467/display/redirect>

Changes:


------------------------------------------
[...truncated 781.35 KB...]
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0912120836-002456'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-12T12:08:43.040556Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-12_05_08_41-14056571143982395224]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-12_05_08_41-14056571143982395224
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_05_08_41-14056571143982395224?project=apache-beam-testing
WARNING  apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:64 Waiting indefinitely for streaming job.
___________________ SideInputsTest.test_flattened_side_input ___________________
[gw7] linux -- Python 3.8.5 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8>

self = <apache_beam.transforms.sideinputs_test.SideInputsTest testMethod=test_flattened_side_input>

    @pytest.mark.it_validatesrunner
    def test_flattened_side_input(self):
      pipeline = self.create_pipeline()
      main_input = pipeline | 'main input' >> beam.Create([None])
      side_input = (
          pipeline | 'side1' >> beam.Create(['a']),
          pipeline | 'side2' >> beam.Create(['b'])) | beam.Flatten()
      results = main_input | beam.FlatMap(
          lambda _, ab: ab, beam.pvalue.AsList(side_input))
    
      assert_that(results, equal_to(['a', 'b']))
>     pipeline.run()

apache_beam/transforms/sideinputs_test.py:365: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <apache_beam.testing.test_pipeline.TestPipeline object at 0x7f35bee72400>
test_runner_api = True

    def run(self, test_runner_api=True):
      result = super(TestPipeline, self).run(
          test_runner_api=(
              False if self.not_use_test_runner_api else test_runner_api))
      if self.blocking:
        state = result.wait_until_finish()
>       assert state in (PipelineState.DONE, PipelineState.CANCELLED), \
            "Pipeline execution failed."
E       AssertionError: Pipeline execution failed.
E       assert 'FAILED' in ('DONE', 'CANCELLED')

apache_beam/testing/test_pipeline.py:117: AssertionError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/requirements.txt...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/pbr-5.5.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/pbr-5.5.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/six-1.15.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/six-1.15.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/dataflow-worker.jar in 3 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-613184.1631448514.613343/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210912120834614381-3550'
                                                                           createTime: '2021-09-12T12:08:41.835971Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-12_05_08_40-10468842769166501562'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0912120834-613184'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-12T12:08:41.835971Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-12_05_08_40-10468842769166501562]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-12_05_08_40-10468842769166501562
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_05_08_40-10468842769166501562?project=apache-beam-testing
WARNING  apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:64 Waiting indefinitely for streaming job.
___________________ SideInputsTest.test_iterable_side_input ____________________
[gw2] linux -- Python 3.8.5 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8>

self = <apache_beam.transforms.sideinputs_test.SideInputsTest testMethod=test_iterable_side_input>

    @pytest.mark.it_validatesrunner
    def test_iterable_side_input(self):
      pipeline = self.create_pipeline()
      pcol = pipeline | 'start' >> beam.Create([1, 2])
      side = pipeline | 'side' >> beam.Create([3, 4])  # 2 values in side input.
      result = pcol | 'compute' >> beam.FlatMap(
          lambda x, s: [x * y for y in s], beam.pvalue.AsIter(side))
      assert_that(result, equal_to([3, 4, 6, 8]))
>     pipeline.run()

apache_beam/transforms/sideinputs_test.py:193: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <apache_beam.testing.test_pipeline.TestPipeline object at 0x7f15e90e6c10>
test_runner_api = True

    def run(self, test_runner_api=True):
      result = super(TestPipeline, self).run(
          test_runner_api=(
              False if self.not_use_test_runner_api else test_runner_api))
      if self.blocking:
        state = result.wait_until_finish()
>       assert state in (PipelineState.DONE, PipelineState.CANCELLED), \
            "Pipeline execution failed."
E       AssertionError: Pipeline execution failed.
E       assert 'FAILED' in ('DONE', 'CANCELLED')

apache_beam/testing/test_pipeline.py:117: AssertionError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/requirements.txt...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/pbr-5.5.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/pbr-5.5.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/six-1.15.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/six-1.15.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/dataflow-worker.jar in 4 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0912120834-883988.1631448514.884132/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210912120834885123-3550'
                                                                           createTime: '2021-09-12T12:08:41.896412Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-12_05_08_41-7193114338615032829'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0912120834-883988'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-12T12:08:41.896412Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-12_05_08_41-7193114338615032829]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-12_05_08_41-7193114338615032829
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_05_08_41-7193114338615032829?project=apache-beam-testing
WARNING  apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:64 Waiting indefinitely for streaming job.
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
========= 28 failed, 3 passed, 1 skipped, 8 warnings in 132.31 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 30s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/mwkmr5ipuifj4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2466

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2466/display/redirect>

Changes:


------------------------------------------
[...truncated 1.96 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:01:33.092Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:01:33.117Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:01:46.407Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:01:46.432Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:01:59.272Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:01:59.297Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:02:12.049Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:02:12.070Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:02:24.868Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:02:24.882Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:02:37.727Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:02:37.747Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:02:51.027Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:02:51.043Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:03.962Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:03.986Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:16.661Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:16.679Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:30.262Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:30.281Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:43.041Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:43.062Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:56.138Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:03:56.157Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:04:09.017Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:04:09.032Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:04:22.042Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:04:22.067Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:04:35.609Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:04:35.626Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:04:49.256Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:04:49.288Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:01.989Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:02.022Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:15.565Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:15.589Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:29.001Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:29.020Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:41.770Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:41.790Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:55Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:05:55.035Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:06:08.294Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:06:08.327Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:06:22.122Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:06:22.143Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:06:35.512Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:06:35.535Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:06:48.997Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:06:49.015Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:02.367Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:02.389Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:14.761Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:14.787Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:27.476Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:27.497Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:40.901Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:40.927Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:54.522Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:07:54.549Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:08.220Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:08.243Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:20.599Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:20.623Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:33.826Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:33.865Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:45.991Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:46.016Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:58.567Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:08:58.592Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:09:10.983Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:09:11.007Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:09:23.531Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:09:23.551Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:09:36.814Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:09:36.843Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:09:48.952Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:09:48.978Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:01.647Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:01.668Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:14.044Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:14.069Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:26.893Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:26.917Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:40.206Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:40.222Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:53.439Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:10:53.461Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:06.702Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:06.722Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:19.320Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:19.344Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:31.379Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:31.428Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:44.578Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:44.595Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:56.638Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:11:56.663Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:12:09.555Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:12:09.584Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:12:23.015Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:12:23.038Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:12:36.401Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:12:36.428Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:12:49.083Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:12:49.103Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:03.259Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:03.282Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:16.651Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:16.668Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:30.169Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:30.209Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:42.466Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:42.493Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:55.345Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:13:55.371Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:14:08.319Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:14:08.343Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:14:20.929Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:14:20.955Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:14:34.510Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:14:34.527Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:14:47.721Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:14:47.745Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:00.488Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:00.511Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:13.262Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:13.282Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:25.299Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:25.318Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:38.705Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:38.734Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:51.488Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:15:51.515Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:04.872Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:04.891Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:17.506Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:17.526Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:30.483Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:30.501Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:43.199Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:43.216Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:55.911Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:16:55.931Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:17:09.426Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:17:09.453Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:17:22.434Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:17:22.458Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:17:35.449Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:17:35.465Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:17:48.370Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:17:48.390Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:01.625Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:01.642Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:15.261Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:15.291Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:28.628Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:28.695Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:42.536Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:42.563Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:55.733Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:18:55.759Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:07.802Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:07.820Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:20.079Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:20.095Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:32.629Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:32.647Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:44.652Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:44.675Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:57.970Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:19:57.989Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:10.740Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:10.766Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:22.847Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:22.866Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:36.298Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:36.316Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:49.157Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:49.174Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:59.253Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2021-09-11_23_06_18-3728348190301214064.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:59.277Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:59.313Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:59.332Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:59.377Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T07:20:59.400Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-11_23_06_18-3728348190301214064 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 16 failed, 15 passed, 1 skipped, 8 warnings in 5897.40 seconds ========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 42m 58s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/gyryvamssvg2y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2465

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2465/display/redirect>

Changes:


------------------------------------------
[...truncated 1.64 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:01:33.194Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:01:33.225Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:01:45.979Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:01:46.010Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:01.048Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:01.079Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:14.826Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:14.858Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:27.251Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:27.296Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:39.627Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:39.659Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:53.341Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:02:53.376Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:06.452Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:06.482Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:19.347Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:19.378Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:31.992Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:32.029Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:45.347Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:45.410Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:58.625Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:03:58.652Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:04:11.598Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:04:11.662Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:04:25.488Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:04:25.515Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:04:38.143Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:04:38.171Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:04:50.871Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:04:50.900Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:03.985Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:04.024Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:17.295Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:17.324Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:31.225Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:31.249Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:44.904Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:44.928Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:57.980Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:05:58.004Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:06:11.361Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:06:11.377Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:06:23.793Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:06:23.823Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:06:37.180Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:06:37.204Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:06:49.883Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:06:49.903Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:02.545Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:02.564Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:15.755Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:15.771Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:29.454Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:29.487Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:42.250Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:42.267Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:56.097Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:07:56.117Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:08:08.897Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:08:08.915Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:08:22.477Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:08:22.503Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:08:36.297Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:08:36.325Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:08:49.769Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:08:49.792Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:02.572Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:02.598Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:15.867Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:15.891Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:29.253Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:29.289Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:42.855Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:42.875Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:57.210Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:09:57.233Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:10:11.119Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:10:11.139Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:10:24.315Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:10:24.337Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:10:37.878Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:10:37.901Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:10:51.296Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:10:51.320Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:04.416Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:04.441Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:17.380Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:17.398Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:31.048Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:31.066Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:44.107Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:44.127Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:57.443Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:11:57.475Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:12:11.112Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:12:11.133Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:12:24.004Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:12:24.021Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:12:38.025Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:12:38.047Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:12:52.449Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:12:52.476Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:05.730Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:05.792Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:19.765Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:19.791Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:33.329Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:33.345Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:46.575Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:46.611Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:59.458Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:13:59.496Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:14:12.554Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:14:12.602Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:14:24.982Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:14:25.002Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:14:37.966Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:14:37.993Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:14:51.206Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:14:51.226Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:04.740Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:04.762Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:17.384Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:17.409Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:30.807Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:30.825Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:44.382Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:44.409Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:57.771Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:15:57.795Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:16:11.447Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:16:11.462Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:16:25.024Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:16:25.049Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:16:38.372Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:16:38.392Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:16:51.885Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:16:51.917Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:05.711Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:05.730Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:18.780Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:18.802Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:32.491Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:32.523Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:45.906Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:45.954Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:59.150Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:17:59.174Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:18:12.454Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:18:12.482Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:18:25.056Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:18:25.080Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:18:38.620Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:18:38.647Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:18:51.280Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:18:51.298Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:04.157Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:04.185Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:18.296Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:18.318Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:31.184Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:31.209Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:45.114Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:45.143Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:57.947Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:19:58.015Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:20:12.147Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:20:12.164Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:20:25.318Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:20:25.343Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:20:38.317Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:20:38.344Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:20:50.746Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:20:50.771Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:03.382Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:03.409Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:17.117Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:17.142Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:30.708Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:30.729Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:43.442Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:43.471Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:56.142Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:21:56.163Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:22:09.848Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-12T01:22:09.873Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-11_17_07_22-6544221365839145004 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 22 failed, 9 passed, 1 skipped, 8 warnings in 5329.48 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 34m 4s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/c24szmksqug3w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2464

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2464/display/redirect>

Changes:


------------------------------------------
[...truncated 826.44 KB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:35:56.987Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:35:57.011Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:09.580Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:09.599Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:21.553Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:21.579Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:34.229Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:34.256Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:47.073Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:47.110Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:59.702Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:36:59.722Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:37:12.110Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:37:12.132Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:37:24.941Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:37:24.957Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:37:37.763Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:37:37.784Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:37:49.974Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:37:50Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:02.731Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:02.756Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:14.759Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:14.822Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:27.782Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:27.800Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:40.612Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:40.633Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:52.972Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:38:52.999Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:05.188Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:05.209Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:17.786Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:17.810Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:30.220Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:30.237Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:42.688Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:42.728Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:55.406Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:39:55.432Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:08.225Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:08.250Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:21.525Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:21.548Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:34.039Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:34.061Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:47.018Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:47.040Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:59.297Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:40:59.317Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:41:11.787Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:41:11.811Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:41:24.490Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:41:24.506Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:41:36.888Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:41:36.904Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:41:49.785Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:41:49.811Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:03.087Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:03.103Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:14.756Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:14.783Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:27.074Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:27.098Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:39.728Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:39.754Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:52.079Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:42:52.107Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:04.374Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:04.392Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:16.864Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:16.897Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:30.041Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:30.068Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:42.483Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:42.503Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:55.278Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:43:55.304Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:08.074Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:08.100Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:21.008Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:21.031Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:33.001Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:33.023Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:45.434Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:45.458Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:57.737Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:44:57.799Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:45:10.404Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:45:10.427Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:45:22.891Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:45:22.916Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:45:34.873Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:45:34.889Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:45:48.079Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:45:48.106Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:01.031Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:01.055Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:13.178Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:13.197Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:25.921Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:25.971Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:37.919Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:37.945Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:50.622Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:46:50.658Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:03.331Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:03.353Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:15.894Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:15.920Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:28.773Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:28.798Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:41.717Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:41.742Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:54.423Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:47:54.447Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:07.559Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:07.585Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:20.910Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:20.939Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:33.136Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:33.158Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:45.478Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:45.499Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:58.109Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:48:58.133Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:49:10.621Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:49:10.640Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:49:23.394Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:49:23.421Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:49:36.456Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:49:36.477Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:49:48.950Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:49:48.970Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:01.612Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:01.643Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:14.221Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:14.248Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:26.538Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:26.559Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:38.923Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:38.945Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:51.832Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:50:51.857Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:04.310Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:04.337Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:16.279Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:16.305Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:28.828Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:28.849Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:41.243Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:41.279Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:53.132Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:51:53.150Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:05.769Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:05.794Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:18.232Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:18.260Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:31.494Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:31.515Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:44.307Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:44.329Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:57.153Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:52:57.189Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:53:09.720Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:53:09.746Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:53:22.462Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:53:22.486Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:53:35.072Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:53:35.095Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:53:48.375Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:53:48.405Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:00.074Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:00.108Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:13.273Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:13.297Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:25.954Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:25.977Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:38.535Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:38.558Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:51.455Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:51.513Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:53.959Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2021-09-11_11_40_01-2941062549191377792.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:53.988Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:54.028Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:54.050Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:54.086Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T19:54:54.113Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-11_11_40_01-2941062549191377792 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 11 failed, 20 passed, 1 skipped, 8 warnings in 5856.40 seconds ========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 5m 42s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/kutyryeotbkrw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2463

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2463/display/redirect>

Changes:


------------------------------------------
[...truncated 1.66 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:33:28.328Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:33:28.357Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:33:41.270Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:33:41.305Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:33:54.511Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:33:54.532Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:34:09.047Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:34:09.086Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:34:21.572Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:34:21.622Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:34:35.044Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:34:35.079Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:34:47.844Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:34:47.877Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:02.204Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:02.236Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:15.491Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:15.527Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:29.357Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:29.383Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:42.848Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:42.882Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:56.962Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:35:56.997Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:36:10.138Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:36:10.168Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:36:23.233Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:36:23.263Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:36:36.647Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:36:36.682Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:36:49.815Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:36:49.865Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:02.424Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:02.450Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:15.621Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:15.641Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:29.367Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:29.395Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:42.946Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:42.976Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:55.690Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:37:55.722Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:38:08.028Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:38:08.063Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:38:21.054Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:38:21.092Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:38:34.294Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:38:34.320Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:38:46.976Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:38:47.017Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:00.407Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:00.445Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:13.897Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:13.924Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:27.768Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:27.803Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:40.861Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:40.896Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:54.203Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:39:54.231Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:07.264Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:07.294Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:20.475Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:20.509Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:33.887Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:33.945Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:46.641Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:46.676Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:58.750Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:40:58.773Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:41:12.614Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:41:12.634Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:41:26.081Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:41:26.113Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:41:39.754Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:41:39.782Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:41:53.014Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:41:53.045Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:05.641Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:05.680Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:19.464Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:19.493Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:32.258Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:32.288Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:45.832Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:45.852Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:58.793Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:42:58.822Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:43:12.499Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:43:12.534Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:43:26.145Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:43:26.175Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:43:38.792Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:43:38.827Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:43:52.906Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:43:52.938Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:44:06.143Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:44:06.176Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:44:19.842Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:44:19.876Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:44:33.177Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:44:33.207Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:44:46.678Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:44:46.705Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:00.627Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:00.663Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:13.583Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:13.605Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:27.720Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:27.751Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:42.023Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:42.043Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:56.036Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:45:56.054Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:46:09.681Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:46:09.707Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:46:22.533Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:46:22.604Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:46:37.299Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:46:37.333Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:46:51.769Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:46:51.799Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:04.474Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:04.511Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:18.039Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:18.059Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:31.424Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:31.465Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:45.265Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:45.298Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:58.307Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:47:58.332Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:48:11.441Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:48:11.475Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:48:24.194Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:48:24.250Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:48:36.794Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:48:36.818Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:48:50.618Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:48:50.654Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:05.006Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:05.028Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:18.928Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:18.956Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:32.664Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:32.700Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:45.792Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:45.827Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:59.563Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:49:59.598Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:50:12.999Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:50:13.037Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:50:25.725Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:50:25.760Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:50:39.531Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:50:39.552Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:50:53.363Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:50:53.400Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:51:06.549Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:51:06.589Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:51:20.355Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:51:20.431Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:51:34.217Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:51:34.242Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:51:48.277Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:51:48.308Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:01.997Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:02.029Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:15.914Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:15.941Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:29.809Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:29.840Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:42.112Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:42.139Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:54.654Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:52:54.681Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:06.906Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:06.931Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:19.315Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:19.337Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:21.314Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2021-09-11_05_38_29-10953891541233754827.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:21.340Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:21.378Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:21.395Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:21.425Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T13:53:21.449Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-11_05_38_29-10953891541233754827 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 13 failed, 18 passed, 1 skipped, 8 warnings in 5870.39 seconds ========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 4m 7s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/qzhruwhlslvhs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2462

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2462/display/redirect>

Changes:


------------------------------------------
[...truncated 485.76 KB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:05.890Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:05.920Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:19.432Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:19.448Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:32.452Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:32.480Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:46.236Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:46.261Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:31:59.983Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:00.008Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:13.141Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:13.156Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:26.519Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:26.544Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:39.719Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:39.741Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:54.295Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:32:54.316Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:33:07.430Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:33:07.455Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:33:20.256Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:33:20.283Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:33:34.074Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:33:34.103Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:33:48.374Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:33:48.408Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:02.522Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:02.537Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:16.492Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:16.519Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:29.669Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:29.689Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:42.908Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:42.927Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:57.169Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:34:57.199Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:35:11.275Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:35:11.298Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:35:24.411Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:35:24.436Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:35:37.872Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:35:37.902Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:35:52.066Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:35:52.095Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:36:05.778Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:36:05.808Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:36:19.673Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:36:19.701Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:36:32.745Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:36:32.772Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:36:46.455Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:36:46.480Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:00.744Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:00.760Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:14.948Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:14.994Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:28.657Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:28.704Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:41.963Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:41.995Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:55.100Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:37:55.132Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:38:09.438Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:38:09.455Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:38:22.348Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:38:22.374Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:38:35.514Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:38:35.531Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:38:48.625Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:38:48.643Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:01.269Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:01.299Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:15.010Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:15.033Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:27.666Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:27.686Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:41.521Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:41.546Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:54.979Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:39:55.003Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:40:08.769Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:40:08.786Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:40:22.031Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:40:22.060Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:40:34.809Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:40:34.839Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:40:49.108Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:40:49.126Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:02.803Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:02.826Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:16.330Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:16.350Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:29.349Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:29.381Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:42.888Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:42.912Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:57.004Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:41:57.042Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:42:09.712Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:42:09.738Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:42:24.232Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:42:24.253Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:42:38.614Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:42:38.633Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:42:52.075Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:42:52.102Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:04.963Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:04.988Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:18.886Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:18.907Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:32.636Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:32.659Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:45.911Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:45.928Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:59.553Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:43:59.571Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:44:13.242Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:44:13.273Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:44:26.685Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:44:26.711Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:44:39.549Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:44:39.578Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:44:53.256Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:44:53.285Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:45:07.527Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:45:07.551Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:45:21.515Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:45:21.540Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:45:34.383Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:45:34.398Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:45:48.135Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:45:48.160Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:01.489Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:01.513Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:14.971Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:14.989Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:28.706Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:28.732Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:42.508Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:42.523Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:56.193Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:46:56.211Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:47:09.193Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:47:09.226Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:47:23.746Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:47:23.774Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:47:36.361Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:47:36.386Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:47:49.637Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:47:49.655Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:02.882Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:02.916Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:15.449Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:15.472Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:28.990Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:29.009Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:42.977Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:43Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:55.562Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:48:55.583Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:08.135Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:08.165Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:20.738Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:20.774Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:33.120Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:33.138Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:45.578Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:45.601Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:57.343Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:49:57.370Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:09.625Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:09.647Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:21.970Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:21.997Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:34.460Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:34.488Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:46.921Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:46.940Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:59.536Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:50:59.566Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:51:12.214Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:51:12.242Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:51:24.253Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:51:24.287Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:51:36.093Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T07:51:36.127Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-10_23_36_49-10151417779387667984 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 1 failed, 30 passed, 1 skipped, 8 warnings in 5204.49 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 2m 44s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/zoc4rcubnxq7i

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2461

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2461/display/redirect?page=changes>

Changes:

[noreply] Port changes from Pub/Sub Lite to beam (#15418)

[heejong] [BEAM-12805] Fix XLang CombinePerKey test by explicitly assigning the

[BenWhitehead] [BEAM-8376] Google Cloud Firestore Connector - Add handling for

[noreply] Decreasing peak memory usage for beam.TupleCombineFn (#15494)

[noreply] [BEAM-12802] Add support for prefetch through data layers down through

[noreply] [BEAM-11097] Add implementation of side input cache (#15483)


------------------------------------------
[...truncated 467.87 KB...]

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests FAILED

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --streaming --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.34.0-SNAPSHOT.jar> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance --enable_streaming_engine
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8
>>>   collect markers: -m=it_validatesrunner and not no_sickbay_streaming and not no_xdist
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw1] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw2] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw4] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw3] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw5] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw6] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw7] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
gw0 [32] / gw1 [32] / gw2 [32] / gw3 [32] / gw4 [32] / gw5 [32] / gw6 [32] / gw7 [32]

scheduling tests via LoadScheduling

apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state 
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values 
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine 
apache_beam/pipeline_test.py::DoFnTest::test_element_param 
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key 
apache_beam/pipeline_test.py::DoFnTest::test_key_param 
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally 
apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo 
[gw7] SKIPPED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections 
[gw4] PASSED apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values 
apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle 
[gw4] PASSED apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs 
[gw1] PASSED apache_beam/pipeline_test.py::DoFnTest::test_key_param 
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest 
[gw1] PASSED apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield 
[gw5] PASSED apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers 
[gw0] PASSED apache_beam/pipeline_test.py::DoFnTest::test_element_param 
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine 
[gw2] PASSED apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo 
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest 
[gw2] PASSED apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice 
[gw3] PASSED apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection 
[gw7] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse 
[gw6] PASSED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection 
[gw1] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_undeclared_outputs 
[gw0] PASSED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs 
[gw2] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_with_different_defaults 
[gw5] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice 
[gw7] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input 
[gw6] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input 
[gw3] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_without_unique_labels 
[gw4] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return 
[gw2] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_with_different_defaults 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_reiterable_side_input 
[gw1] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_undeclared_outputs 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input 
[gw6] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input 
[gw0] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input 
[gw7] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input 
[gw3] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_without_unique_labels 
[gw5] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice 
apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps 
[gw4] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return 
[gw2] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_reiterable_side_input 
[gw0] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input 
[gw1] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input 
[gw5] PASSED apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps 

=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
============= 31 passed, 1 skipped, 8 warnings in 2690.64 seconds ==============
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --streaming --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.34.0-SNAPSHOT.jar> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance --enable_streaming_engine
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO
>>>   collect markers: -m=it_validatesrunner and not no_sickbay_streaming and no_xdist
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False

----------------------------- live log collection ------------------------------
WARNING  root:avroio_test.py:56 python-snappy is not installed; some tests will be skipped.
WARNING  root:tfrecordio_test.py:55 Tensorflow is not installed, so skipping some tests.
WARNING  apache_beam.runners.interactive.interactive_environment:interactive_environment.py:180 Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING  apache_beam.runners.interactive.interactive_environment:interactive_environment.py:189 You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
collected 4996 items / 4995 deselected / 1 selected

apache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py::ExerciseStreamingMetricsPipelineTest::test_streaming_pipeline_returns_expected_user_metrics_fnapi_it 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.internal.gcp.auth:auth.py:106 Setting socket default timeout to 60 seconds.
INFO     apache_beam.internal.gcp.auth:auth.py:108 socket default timeout is 60.0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/requirements.txt...
INFO     oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token
INFO     oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/pickled_main_session...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/pickled_main_session in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/dataflow-worker.jar in 4 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0911014157-319756.1631324517.319919/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210911014157321167-7102'
                                                                           createTime: '2021-09-11T01:42:04.567579Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-10_18_42_03-687381706670644471'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0911014157-319756'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-11T01:42:04.567579Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-10_18_42_03-687381706670644471]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-10_18_42_03-687381706670644471
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_18_42_03-687381706670644471?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_18_42_03-687381706670644471?project=apache-beam-testing
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-10_18_42_03-687381706670644471 is in state JOB_STATE_RUNNING
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:08.362Z: JOB_MESSAGE_WARNING: Autoscaling is enabled for Dataflow Streaming Engine. Workers will scale between 1 and 100 unless maxNumWorkers is specified.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:08.479Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2021-09-10_18_42_03-687381706670644471. The number of workers will be between 1 and 100.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:08.559Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2021-09-10_18_42_03-687381706670644471.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:13.039Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-a.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:13.811Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:13.901Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.002Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.049Z: JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.080Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write steps
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.111Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.132Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.164Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.194Z: JOB_MESSAGE_DETAILED: Fusing consumer generate_metrics into ReadFromPubSub/Read
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.217Z: JOB_MESSAGE_DETAILED: Fusing consumer dump_to_pub/ToProtobuf into generate_metrics
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.250Z: JOB_MESSAGE_DETAILED: Fusing consumer dump_to_pub/Write/NativeWrite into dump_to_pub/ToProtobuf
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.284Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.313Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.342Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.382Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.443Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.470Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:14.499Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:50.094Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-11T01:42:58.368Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
WARNING  apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:247 Timing out on waiting for job 2021-09-10_18_42_03-687381706670644471 after 60 seconds
PASSED

=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-noxdist.xml> -
=========== 1 passed, 4995 deselected, 1 warnings in 610.29 seconds ============

> Task :sdks:python:test-suites:dataflow:validatesRunnerStreamingTestsV2

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 51m 29s
84 actionable tasks: 67 executed, 17 from cache

Publishing build scan...
https://gradle.com/s/fa4dmb4bgqej6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2460

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2460/display/redirect?page=changes>

Changes:

[noreply] Added type annotations to some combiners missing it. (#15414)

[noreply] [BEAM-12634] JmsIO auto scaling feature (#15464)

[noreply] [BEAM-12662] Get Flink version from cluster. (#15223)


------------------------------------------
[...truncated 1.77 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:43:56.868Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:43:56.888Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:44:09.850Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:44:09.886Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:44:22.471Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:44:22.498Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:44:35.008Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:44:35.035Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:44:47.913Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:44:47.945Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:00.881Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:00.905Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:14.026Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:14.051Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:26.367Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:26.393Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:38.975Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:39.005Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:51.756Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:45:51.778Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:04.186Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:04.205Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:17.085Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:17.102Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:29.637Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:29.666Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:42.898Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:42.924Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:55.624Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:46:55.650Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:08.327Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:08.356Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:20.778Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:20.799Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:33.805Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:33.833Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:46.203Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:46.231Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:58.673Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:47:58.696Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:48:12.161Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:48:12.183Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:48:25.706Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:48:25.724Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:48:38.884Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:48:38.919Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:48:51.859Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:48:51.887Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:04.002Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:04.029Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:17.656Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:17.686Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:30.358Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:30.387Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:42.984Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:43.014Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:55.673Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:49:55.709Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:08.493Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:08.546Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:21.520Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:21.559Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:33.743Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:33.779Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:45.792Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:45.817Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:58.442Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:50:58.471Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:51:12.191Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:51:12.218Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:51:24.739Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:51:24.756Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:51:37.365Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:51:37.387Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:51:49.527Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:51:49.562Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:01.711Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:01.743Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:14.231Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:14.256Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:26.906Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:26.932Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:39.124Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:39.172Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:51.566Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:52:51.591Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:04.371Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:04.391Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:17.589Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:17.628Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:30.483Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:30.501Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:43.099Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:43.124Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:55.973Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:53:55.999Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:09.002Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:09.034Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:20.901Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:20.935Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:33.200Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:33.294Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:46.357Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:46.381Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:58.969Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:54:58.986Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:55:11.578Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:55:11.682Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:55:24.309Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:55:24.335Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:55:36.792Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:55:36.820Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:55:49.101Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:55:49.131Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:01.591Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:01.678Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:14.154Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:14.173Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:26.199Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:26.228Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:38.867Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:38.895Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:51.985Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:56:52.008Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:04.585Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:04.611Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:17.515Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:17.537Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:30.191Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:30.215Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:42.959Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:42.987Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:56.163Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:57:56.223Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:58:09.490Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:58:09.516Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:58:22.337Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:58:22.372Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:58:35.187Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:58:35.240Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:58:47.068Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:58:47.096Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:00.564Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:00.602Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:14.029Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:14.065Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:26.743Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:26.764Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:39.162Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:39.185Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:51.804Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T19:59:51.837Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:04.742Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:04.772Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:18.538Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:18.564Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:31.735Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:31.763Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:44.401Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:44.426Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:57.155Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:00:57.185Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:01:10.326Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:01:10.347Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:01:22.511Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:01:22.528Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:01:35.896Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:01:35.924Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:01:49.204Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:01:49.232Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:02.045Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:02.085Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:14.628Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:14.654Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:27.121Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:27.151Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:41.078Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:41.108Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:53.493Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:02:53.522Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:03:06.326Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:03:06.346Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:03:19.369Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:03:19.404Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:03:32.655Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T20:03:32.738Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-10_11_48_57-13555677103240010003 is in state JOB_STATE_CANCELLING
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 9 failed, 22 passed, 1 skipped, 8 warnings in 6568.08 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 26m 10s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/ifmvk2n7apo4w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2459

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2459/display/redirect?page=changes>

Changes:

[noreply] Register MapCoder, some comments/cleanup. (#15471)

[noreply] [BEAM-12588] Multimap user state proto changes (#15473)


------------------------------------------
[...truncated 358.69 KB...]

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests FAILED

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --streaming --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.34.0-SNAPSHOT.jar> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance --enable_streaming_engine
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8
>>>   collect markers: -m=it_validatesrunner and not no_sickbay_streaming and not no_xdist
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw1] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw3] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw2] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw4] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw5] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw6] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw7] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
gw0 [32] / gw1 [32] / gw2 [32] / gw3 [32] / gw4 [32] / gw5 [32] / gw6 [32] / gw7 [32]

scheduling tests via LoadScheduling

apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state 
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key 
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values 
apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo 
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally 
apache_beam/pipeline_test.py::DoFnTest::test_element_param 
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine 
apache_beam/pipeline_test.py::DoFnTest::test_key_param 
[gw7] SKIPPED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections 
[gw2] PASSED apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values 
apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle 
[gw7] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse 
[gw0] PASSED apache_beam/pipeline_test.py::DoFnTest::test_element_param 
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine 
[gw3] PASSED apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo 
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest 
[gw1] PASSED apache_beam/pipeline_test.py::DoFnTest::test_key_param 
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest 
[gw3] PASSED apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_undeclared_outputs 
[gw1] PASSED apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice 
[gw6] PASSED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection 
[gw2] PASSED apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs 
[gw4] PASSED apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection 
[gw5] PASSED apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers 
[gw7] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return 
[gw0] PASSED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield 
[gw3] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_undeclared_outputs 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs 
[gw1] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice 
[gw2] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_without_unique_labels 
[gw4] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input 
[gw6] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_with_different_defaults 
[gw5] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input 
[gw7] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input 
[gw0] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input 
[gw3] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_reiterable_side_input 
[gw1] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice 
apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps 
[gw2] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_without_unique_labels 
[gw4] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input 
[gw6] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_with_different_defaults 
[gw5] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input 
[gw0] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input 
[gw3] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_reiterable_side_input 
[gw1] PASSED apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps 
[gw7] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input 

=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
============= 31 passed, 1 skipped, 8 warnings in 2690.10 seconds ==============
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --streaming --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.34.0-SNAPSHOT.jar> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance --enable_streaming_engine
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO
>>>   collect markers: -m=it_validatesrunner and not no_sickbay_streaming and no_xdist
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False

----------------------------- live log collection ------------------------------
WARNING  root:avroio_test.py:56 python-snappy is not installed; some tests will be skipped.
WARNING  root:tfrecordio_test.py:55 Tensorflow is not installed, so skipping some tests.
WARNING  apache_beam.runners.interactive.interactive_environment:interactive_environment.py:180 Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING  apache_beam.runners.interactive.interactive_environment:interactive_environment.py:189 You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
collected 4992 items / 4991 deselected / 1 selected

apache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py::ExerciseStreamingMetricsPipelineTest::test_streaming_pipeline_returns_expected_user_metrics_fnapi_it 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.internal.gcp.auth:auth.py:106 Setting socket default timeout to 60 seconds.
INFO     apache_beam.internal.gcp.auth:auth.py:108 socket default timeout is 60.0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/requirements.txt...
INFO     oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token
INFO     oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/pickled_main_session...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/pickled_main_session in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/dataflow-worker.jar in 3 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910133945-567719.1631281185.567878/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210910133945569170-7102'
                                                                           createTime: '2021-09-10T13:39:51.738200Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-10_06_39_50-13644987626069156415'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0910133945-567719'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-10T13:39:51.738200Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-10_06_39_50-13644987626069156415]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-10_06_39_50-13644987626069156415
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_06_39_50-13644987626069156415?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_06_39_50-13644987626069156415?project=apache-beam-testing
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-10_06_39_50-13644987626069156415 is in state JOB_STATE_RUNNING
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:54.526Z: JOB_MESSAGE_WARNING: Autoscaling is enabled for Dataflow Streaming Engine. Workers will scale between 1 and 100 unless maxNumWorkers is specified.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:54.659Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2021-09-10_06_39_50-13644987626069156415. The number of workers will be between 1 and 100.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:54.688Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2021-09-10_06_39_50-13644987626069156415.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:57.982Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-a.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.651Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.714Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.774Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.804Z: JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.832Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write steps
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.854Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.880Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.911Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.934Z: JOB_MESSAGE_DETAILED: Fusing consumer generate_metrics into ReadFromPubSub/Read
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.966Z: JOB_MESSAGE_DETAILED: Fusing consumer dump_to_pub/ToProtobuf into generate_metrics
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:58.999Z: JOB_MESSAGE_DETAILED: Fusing consumer dump_to_pub/Write/NativeWrite into dump_to_pub/ToProtobuf
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:59.026Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:59.056Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:59.079Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:59.101Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:59.155Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:59.181Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:39:59.209Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:40:12.956Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T13:40:43.974Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
WARNING  apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:247 Timing out on waiting for job 2021-09-10_06_39_50-13644987626069156415 after 61 seconds
PASSED

=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-noxdist.xml> -
=========== 1 passed, 4991 deselected, 1 warnings in 643.81 seconds ============

> Task :sdks:python:test-suites:dataflow:validatesRunnerStreamingTestsV2

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 49m 43s
84 actionable tasks: 66 executed, 18 from cache

Publishing build scan...
https://gradle.com/s/gjzbthmzwnaum

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2458

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2458/display/redirect?page=changes>

Changes:

[ruwan.lambrichts] Clarify additional_bq_parameters argument

[esert] Bump a throttling counter on BigQueryRead retries due to

[noreply] [BEAM-5097] Increment counter for "small words" in go SDK example


------------------------------------------
[...truncated 216.04 KB...]

    def __ProcessHttpResponse(self, method_config, http_response, request):
        """Process the given http response."""
        if http_response.status_code not in (http_client.OK,
                                             http_client.CREATED,
                                             http_client.NO_CONTENT):
>           raise exceptions.HttpError.FromResponse(
                http_response, method_config=method_config, request=request)
E           apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2021-09-09_23_57_49-13970793522758530662?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Fri, 10 Sep 2021 07:07:51 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '400', 'content-length': '316', '-content-encoding': 'gzip'}>, content <{
E             "error": {
E               "code": 400,
E               "message": "(dfeda32b2621dab6): Workflow modification failed. Causes: (3b902cf7dc17aebe): Operation cancel not allowed for job 2021-09-09_23_57_49-13970793522758530662. Job is not yet ready for canceling. Please retry in a few minutes.",
E               "status": "FAILED_PRECONDITION"
E             }
E           }
E           >

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py:603: HttpBadRequestError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.internal.gcp.auth:auth.py:106 Setting socket default timeout to 60 seconds.
INFO     apache_beam.internal.gcp.auth:auth.py:108 socket default timeout is 60.0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/requirements.txt...
INFO     oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token
INFO     oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/dataflow-worker.jar in 4 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210910065743390297-9101'
                                                                           createTime: '2021-09-10T06:57:50.619687Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-09_23_57_49-13970793522758530662'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0910065743-388911'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-10T06:57:50.619687Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-09_23_57_49-13970793522758530662]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-09_23_57_49-13970793522758530662
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-09_23_57_49-13970793522758530662?project=apache-beam-testing
_______________ CombineFnLifecycleTest.test_non_liftable_combine _______________
[gw0] linux -- Python 3.8.5 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8>

self = <apache_beam.transforms.combinefn_lifecycle_test.CombineFnLifecycleTest testMethod=test_non_liftable_combine>

    @skip_unless_v2
    def test_non_liftable_combine(self):
>     run_combine(self.pipeline, lift_combiners=False)

apache_beam/transforms/combinefn_lifecycle_test.py:69: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/transforms/combinefn_lifecycle_pipeline.py:124: in run_combine
    assert_that(pcoll, equal_to([(expected_result, expected_result)]))
apache_beam/pipeline.py:586: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:112: in run
    result = super(TestPipeline, self).run(
apache_beam/pipeline.py:565: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/dataflow/test_dataflow_runner.py:72: in run_pipeline
    self.result.cancel()
apache_beam/runners/dataflow/dataflow_runner.py:1650: in cancel
    if not self._runner.dataflow_client.modify_job_state(
apache_beam/utils/retry.py:253: in wrapper
    return fun(*args, **kwargs)
apache_beam/runners/dataflow/internal/apiclient.py:860: in modify_job_state
    self._client.projects_locations_jobs.Update(request)
apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py:1058: in Update
    return self._RunMethod(
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py:731: in _RunMethod
    return self.ProcessHttpResponse(method_config, http_response, request)
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py:737: in ProcessHttpResponse
    self.__ProcessHttpResponse(method_config, http_response, request))
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <apache_beam.runners.dataflow.internal.clients.dataflow.dataflow_v1b3_client.DataflowV1b3.ProjectsLocationsJobsService object at 0x7f8eedbe9f40>
method_config = <ApiMethodInfo
 relative_path: 'v1b3/projects/{projectId}/locations/{location}/jobs/{jobId}'
 method_id: 'dataflow.pro...DataflowProjectsLocationsJobsUpdateRequest'
 response_type_name: 'Job'
 request_field: 'job'
 supports_download: False>
http_response = Response(info={'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Fri, 1...is.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2021-09-10_00_08_46-10804524149224577070?alt=json')
request = <DataflowProjectsLocationsJobsUpdateRequest
 job: <Job
 requestedState: RequestedStateValueValuesEnum(JOB_STATE_CANCEL...les: []>
 jobId: '2021-09-10_00_08_46-10804524149224577070'
 location: 'us-central1'
 projectId: 'apache-beam-testing'>

    def __ProcessHttpResponse(self, method_config, http_response, request):
        """Process the given http response."""
        if http_response.status_code not in (http_client.OK,
                                             http_client.CREATED,
                                             http_client.NO_CONTENT):
>           raise exceptions.HttpError.FromResponse(
                http_response, method_config=method_config, request=request)
E           apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2021-09-10_00_08_46-10804524149224577070?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Fri, 10 Sep 2021 07:18:52 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '400', 'content-length': '315', '-content-encoding': 'gzip'}>, content <{
E             "error": {
E               "code": 400,
E               "message": "(74e0a7d7a90da795): Workflow modification failed. Causes: (ce7d64d92bb8061): Operation cancel not allowed for job 2021-09-10_00_08_46-10804524149224577070. Job is not yet ready for canceling. Please retry in a few minutes.",
E               "status": "FAILED_PRECONDITION"
E             }
E           }
E           >

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py:603: HttpBadRequestError
------------------------------ Captured log call -------------------------------
WARNING  apache_beam.transforms.core:core.py:2337 GroupByKey: Unsafe trigger `AfterCount(5)` detected (reason: CONDITION_NOT_GUARANTEED|MAY_FINISH). This is being allowed because --allow_unsafe_triggers is set. This could lead to missing or incomplete groups.
WARNING  apache_beam.transforms.core:core.py:2337 GroupByKey: Unsafe trigger `AfterCount(5)` detected (reason: CONDITION_NOT_GUARANTEED|MAY_FINISH). This is being allowed because --allow_unsafe_triggers is set. This could lead to missing or incomplete groups.
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/requirements.txt...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/dataflow-worker.jar in 4 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210910070840345666-2535'
                                                                           createTime: '2021-09-10T07:08:47.861174Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-10_00_08_46-10804524149224577070'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0910070840-344406'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-10T07:08:47.861174Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-10_00_08_46-10804524149224577070]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-10_00_08_46-10804524149224577070
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_00_08_46-10804524149224577070?project=apache-beam-testing
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 2 failed, 29 passed, 1 skipped, 8 warnings in 2645.47 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 40m 57s
84 actionable tasks: 56 executed, 28 from cache

Publishing build scan...
https://gradle.com/s/7a2fm4gydsdnc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2457

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2457/display/redirect?page=changes>

Changes:

[noreply] Fix broken 'differences from pandas' link

[noreply] Added GroupBy row in Aggregation table.

[Luke Cwik] [BEAM-12769] Fix typo in test class name, CLass -> Class

[Etienne Chauchot] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a

[samuelw] [BEAM-12740] Remove matching to filter files when renaming gcs files in

[noreply] [BEAM-3304] Helper functions for triggers (#15430)


------------------------------------------
[...truncated 1.02 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:27:50.017Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:27:50.042Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:02.863Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:02.882Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:16.492Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:16.581Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:29.558Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:29.605Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:42.111Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:42.164Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:54.456Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:28:54.482Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:06.560Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:06.595Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:19.374Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:19.398Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:32.638Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:32.761Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:45.379Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:45.396Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:57.831Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:29:57.868Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:30:11.080Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:30:11.141Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:30:23.743Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:30:23.769Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:30:36.318Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:30:36.338Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:30:49.828Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:30:49.848Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:02.332Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:02.351Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:15.281Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:15.306Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:27.873Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:27.894Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:40.907Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:40.961Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:53.552Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:31:53.613Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:06.433Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:06.457Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:19.125Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:19.165Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:31.304Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:31.328Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:43.752Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:43.780Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:56.627Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:32:56.644Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:33:09.602Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:33:09.633Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:33:22.331Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:33:22.348Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:33:34.860Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:33:34.885Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:33:48.641Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:33:48.666Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:00.876Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:00.897Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:13.654Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:13.680Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:26.186Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:26.203Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:38.602Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:38.634Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:51.119Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:34:51.159Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:04.243Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:04.277Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:17.651Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:17.679Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:30.755Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:30.773Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:42.932Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:42.950Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:55.599Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:35:55.643Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:08.035Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:08.060Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:20.696Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:20.719Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:33.244Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:33.270Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:45.693Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:45.718Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:59.082Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:36:59.106Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:37:12.129Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:37:12.168Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:37:24.418Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:37:24.436Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:37:37.140Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:37:37.181Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:37:49.667Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:37:49.697Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:01.820Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:01.863Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:14.766Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:14.790Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:27.209Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:27.244Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:40.131Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:40.174Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:53.853Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:38:53.897Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:06.484Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:06.514Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:18.701Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:18.734Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:30.988Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:31.052Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:44.111Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:44.154Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:56.653Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:39:56.716Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:40:09.370Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:40:09.398Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:40:22.400Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:40:22.431Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:40:35.430Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:40:35.451Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:40:48.208Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:40:48.229Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:00.560Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:00.584Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:13.838Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:13.858Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:25.859Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:25.884Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:38.959Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:38.975Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:51.920Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:41:51.940Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:05.229Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:05.261Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:18.948Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:18.971Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:31.832Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:31.858Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:45.123Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:45.198Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:57.848Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:42:57.861Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:43:09.985Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:43:10.004Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:43:22.803Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:43:22.819Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:43:36.218Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:43:36.236Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:43:49.177Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:43:49.221Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:01.634Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:01.663Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:14.730Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:14.752Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:27.862Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:27.888Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:40.810Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:40.830Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:53.833Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:44:53.928Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:06.740Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:06.756Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:19.189Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:19.221Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:31.491Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:31.516Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:44.502Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:44.536Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:57.483Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:45:57.508Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:46:10.389Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:46:10.460Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:46:23.156Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:46:23.182Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:46:36.266Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:46:36.287Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:46:48.621Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:46:48.646Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:47:01.763Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:47:01.785Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:47:14.163Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:47:14.218Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:47:27.136Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:47:27.161Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:47:39.840Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T01:47:39.860Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-09_17_33_03-6224091621778179217 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 27 failed, 4 passed, 1 skipped, 8 warnings in 5250.09 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 58m 7s
84 actionable tasks: 69 executed, 15 from cache

Publishing build scan...
https://gradle.com/s/n45zhqcd42ltk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2456

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2456/display/redirect?page=changes>

Changes:

[kawaigin] [BEAM-10708] Support streaming cache in beam_sql magic


------------------------------------------
[...truncated 1.11 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:17:21.560Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:17:21.591Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:17:35.633Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:17:35.665Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:17:48.787Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:17:48.815Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:00.787Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:00.828Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:13.867Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:13.903Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:27.436Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:27.470Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:40.512Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:40.586Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:53.163Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:18:53.192Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:06.686Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:06.727Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:20.206Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:20.244Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:33.404Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:33.441Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:46.552Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:46.584Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:59.490Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:19:59.516Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:20:13.101Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:20:13.139Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:20:26.085Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:20:26.121Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:20:38.343Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:20:38.370Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:20:52.213Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:20:52.250Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:05.289Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:05.340Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:18.582Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:18.632Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:31.841Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:31.908Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:45.104Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:45.135Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:58.451Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:21:58.488Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:22:11.230Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:22:11.264Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:22:24.643Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:22:24.728Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:22:38.252Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:22:38.297Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:22:51.053Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:22:51.089Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:03.936Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:03.976Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:16.948Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:16.977Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:30Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:30.038Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:43.416Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:43.448Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:56.672Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:23:56.706Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:24:09.095Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:24:09.133Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:24:21.750Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:24:21.854Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:24:34.723Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:24:34.764Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:24:47.964Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:24:47.994Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:00.928Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:00.956Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:13.430Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:13.465Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:26.632Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:26.649Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:40.080Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:40.116Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:53.741Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:25:53.873Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:26:06.959Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:26:06.984Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:26:20.184Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:26:20.209Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:26:34.240Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:26:34.276Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:26:47.625Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:26:47.668Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:00.663Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:00.697Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:13.684Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:13.791Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:26.970Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:27.016Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:40.013Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:40.049Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:53.378Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:27:53.404Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:06.178Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:06.218Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:18.972Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:18.994Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:31.738Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:31.769Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:44.414Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:44.433Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:57.835Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:28:57.860Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:29:10.597Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:29:10.630Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:29:23.188Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:29:23.219Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:29:36.077Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:29:36.110Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:29:49.818Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:29:49.864Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:02.137Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:02.190Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:15.647Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:15.684Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:28.851Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:28.901Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:42.567Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:42.598Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:55.973Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:30:55.998Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:31:08.760Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:31:08.883Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:31:22.334Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:31:22.368Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:31:36.093Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:31:36.122Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:31:49.360Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:31:49.387Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:02.757Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:02.831Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:16.364Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:16.416Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:29.646Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:29.684Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:42.705Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:42.734Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:56.594Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:32:56.627Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:33:10.033Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:33:10.063Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:33:24.242Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:33:24.272Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:33:38.327Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:33:38.359Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:33:51.653Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:33:51.686Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:04.081Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:04.107Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:17.079Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:17.107Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:30.715Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:30.753Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:43.140Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:43.171Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:55.981Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:34:56.013Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:35:09.260Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:35:09.293Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:35:22.373Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:35:22.403Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:35:35.924Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:35:35.961Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:35:49.306Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:35:49.355Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:02.599Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:02.661Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:16.020Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:16.052Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:28.735Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:28.773Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:42.070Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:42.105Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:55.566Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:55.603Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:56.400Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2021-09-09_11_22_28-11359870978134109801.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:56.484Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:56.605Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:56.663Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:56.719Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T19:36:56.755Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-09_11_22_28-11359870978134109801 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 25 failed, 6 passed, 1 skipped, 8 warnings in 5294.69 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 47m 47s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/d23hrft5sgiyu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2455

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2455/display/redirect>

Changes:


------------------------------------------
[...truncated 1.70 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:24:06.667Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:24:06.686Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:24:20.291Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:24:20.310Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:24:33.840Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:24:33.872Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:24:47.067Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:24:47.086Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:00.326Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:00.345Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:14.232Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:14.261Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:27.060Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:27.087Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:39.798Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:39.826Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:52.592Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:25:52.609Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:05.533Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:05.551Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:18.857Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:18.886Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:32.077Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:32.103Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:45.738Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:45.764Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:58.779Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:26:58.805Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:27:12.754Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:27:12.780Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:27:26.074Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:27:26.104Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:27:39.105Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:27:39.130Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:27:53.151Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:27:53.188Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:28:06.859Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:28:06.893Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:28:19.950Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:28:20.008Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:28:33.187Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:28:33.244Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:28:47.016Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:28:47.041Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:00.606Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:00.630Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:13.463Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:13.492Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:26.799Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:26.819Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:40.391Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:40.420Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:53.342Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:29:53.361Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:06.364Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:06.384Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:18.715Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:18.738Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:31.584Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:31.608Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:45.022Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:45.043Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:57.502Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:30:57.527Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:31:10.010Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:31:10.030Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:31:22.898Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:31:22.926Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:31:36.010Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:31:36.033Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:31:48.677Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:31:48.712Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:00.863Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:00.889Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:13.372Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:13.390Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:25.576Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:25.604Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:37.717Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:37.749Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:50.376Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:32:50.394Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:02.967Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:02.995Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:15.578Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:15.607Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:27.707Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:27.724Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:40.095Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:40.119Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:52.369Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:33:52.398Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:04.951Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:04.975Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:17.548Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:17.570Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:30.753Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:30.775Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:42.957Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:42.981Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:55.646Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:34:55.671Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:08.557Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:08.631Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:21.383Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:21.399Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:33.833Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:33.855Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:46.480Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:46.505Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:59.137Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:35:59.162Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:36:11.931Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:36:11.952Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:36:24.228Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:36:24.300Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:36:36.656Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:36:36.681Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:36:48.889Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:36:48.909Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:01.131Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:01.153Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:13.852Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:13.883Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:26.495Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:26.521Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:39.054Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:39.099Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:51.890Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:37:51.904Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:04.449Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:04.478Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:16.974Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:16.998Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:30.113Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:30.142Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:42.452Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:42.482Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:55.135Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:38:55.169Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:08.188Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:08.210Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:20.964Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:20.993Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:34.596Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:34.617Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:47.059Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:47.107Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:59.260Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:39:59.285Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:40:11.787Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:40:11.809Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:40:24.489Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:40:24.515Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:40:37.278Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:40:37.338Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:40:49.896Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:40:49.920Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:02.479Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:02.508Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:15.141Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:15.167Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:27.708Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:27.730Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:39.972Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:39.996Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:52.479Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:41:52.508Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:04.885Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:04.916Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:17.826Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:17.847Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:30.972Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:30.992Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:43.064Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:43.087Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:55.836Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:42:55.862Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:08.626Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:08.643Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:21.628Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:21.648Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:31.517Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2021-09-09_05_28_38-6588132257357097820.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:31.551Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:31.588Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:31.608Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:31.638Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T13:43:31.654Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-09_05_28_38-6588132257357097820 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 11 failed, 20 passed, 1 skipped, 8 warnings in 5981.55 seconds ========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 55m 43s
84 actionable tasks: 54 executed, 30 from cache

Publishing build scan...
https://gradle.com/s/idhqorkzk4wks

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2454

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2454/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #15480: [BEAM-12356] Make sure DatasetService is

[noreply] [BEAM-11981] Java Bigtable - Implement IO Request Count metrics (#15342)

[noreply] [BEAM-12834] Improve Go SDK cross-language documentation and API.


------------------------------------------
[...truncated 190.63 KB...]
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --streaming --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.34.0-SNAPSHOT.jar> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance --enable_streaming_engine
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8
>>>   collect markers: -m=it_validatesrunner and not no_sickbay_streaming and not no_xdist
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw2] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw5] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw1] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw4] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw3] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw6] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
[gw7] Python 3.8.5 (default, Jul 20 2020, 19:50:14)  -- [GCC 5.4.0 20160609]
gw0 [32] / gw1 [32] / gw2 [32] / gw3 [32] / gw4 [32] / gw5 [32] / gw6 [32] / gw7 [32]

scheduling tests via LoadScheduling

apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state 
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values 
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally 
apache_beam/pipeline_test.py::DoFnTest::test_element_param 
apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo 
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine 
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key 
apache_beam/pipeline_test.py::DoFnTest::test_key_param 
[gw7] SKIPPED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections 
[gw1] PASSED apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values 
apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle 
[gw7] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse 
[gw1] PASSED apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs 
[gw2] PASSED apache_beam/pipeline_test.py::DoFnTest::test_key_param 
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest 
[gw2] PASSED apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_undeclared_outputs 
[gw5] PASSED apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo 
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest 
[gw5] PASSED apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs 
[gw6] PASSED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection 
[gw4] PASSED apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection 
[gw3] PASSED apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers 
[gw0] PASSED apache_beam/pipeline_test.py::DoFnTest::test_element_param 
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine 
[gw1] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield 
[gw7] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse 
apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return 
[gw5] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice 
[gw2] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_undeclared_outputs 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice 
[gw6] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_with_different_defaults 
[gw4] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_without_unique_labels 
[gw3] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input 
[gw0] PASSED apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input 
[gw2] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice 
apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps 
[gw1] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input 
[gw7] PASSED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input 
[gw5] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice 
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_reiterable_side_input 
[gw4] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_without_unique_labels 
[gw6] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_with_different_defaults 
[gw3] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input 
[gw0] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input 
[gw7] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input 
[gw2] PASSED apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps 
[gw1] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input 
[gw5] PASSED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_reiterable_side_input 

=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
============= 31 passed, 1 skipped, 8 warnings in 2665.15 seconds ==============
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --streaming --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.34.0-SNAPSHOT.jar> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance --enable_streaming_engine
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO
>>>   collect markers: -m=it_validatesrunner and not no_sickbay_streaming and no_xdist
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False

----------------------------- live log collection ------------------------------
WARNING  root:avroio_test.py:56 python-snappy is not installed; some tests will be skipped.
WARNING  root:tfrecordio_test.py:55 Tensorflow is not installed, so skipping some tests.
WARNING  apache_beam.runners.interactive.interactive_environment:interactive_environment.py:180 Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING  apache_beam.runners.interactive.interactive_environment:interactive_environment.py:189 You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
collected 4992 items / 4991 deselected / 1 selected

apache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py::ExerciseStreamingMetricsPipelineTest::test_streaming_pipeline_returns_expected_user_metrics_fnapi_it 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
INFO     apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO     root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO     root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO     root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO     apache_beam.internal.gcp.auth:auth.py:106 Setting socket default timeout to 60 seconds.
INFO     apache_beam.internal.gcp.auth:auth.py:108 socket default timeout is 60.0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/requirements.txt...
INFO     oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token
INFO     oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/requirements.txt in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/pickled_main_session...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/pickled_main_session in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/pbr-5.5.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/pbr-5.5.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/pbr-5.6.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/pbr-5.6.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/mock-2.0.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/mock-2.0.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/six-1.16.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/six-1.16.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/soupsieve-2.2.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/soupsieve-2.2.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/soupsieve-2.2.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/soupsieve-2.2.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/PyHamcrest-1.10.1.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/PyHamcrest-1.10.1.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/parameterized-0.7.5.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/parameterized-0.7.5.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/beautifulsoup4-4.9.3.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/beautifulsoup4-4.9.3.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/beautifulsoup4-4.10.0.tar.gz...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/beautifulsoup4-4.10.0.tar.gz in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/dataflow_python_sdk.tar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/dataflow_python_sdk.tar in 0 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/dataflow-worker.jar...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/dataflow-worker.jar in 3 seconds.
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/pipeline.pb...
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0909074418-214232.1631173458.214386/pipeline.pb in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20']
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
                                                                           clientRequestId: '20210909074418215481-7102'
                                                                           createTime: '2021-09-09T07:44:24.416950Z'
                                                                           currentStateTime: '1970-01-01T00:00:00Z'
                                                                           id: '2021-09-09_00_44_23-919332740186725729'
                                                                           location: 'us-central1'
                                                                           name: 'beamapp-jenkins-0909074418-214232'
                                                                           projectId: 'apache-beam-testing'
                                                                           stageStates: []
                                                                           startTime: '2021-09-09T07:44:24.416950Z'
                                                                           steps: []
                                                                           tempFiles: []
                                                                           type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-09_00_44_23-919332740186725729]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-09_00_44_23-919332740186725729
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-09_00_44_23-919332740186725729?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-09_00_44_23-919332740186725729?project=apache-beam-testing
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-09_00_44_23-919332740186725729 is in state JOB_STATE_RUNNING
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:27.287Z: JOB_MESSAGE_WARNING: Autoscaling is enabled for Dataflow Streaming Engine. Workers will scale between 1 and 100 unless maxNumWorkers is specified.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:27.406Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2021-09-09_00_44_23-919332740186725729. The number of workers will be between 1 and 100.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:27.428Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2021-09-09_00_44_23-919332740186725729.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:32.637Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-a.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:33.735Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:33.769Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:33.849Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:33.989Z: JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.092Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write steps
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.166Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.247Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.319Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.360Z: JOB_MESSAGE_DETAILED: Fusing consumer generate_metrics into ReadFromPubSub/Read
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.386Z: JOB_MESSAGE_DETAILED: Fusing consumer dump_to_pub/ToProtobuf into generate_metrics
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.418Z: JOB_MESSAGE_DETAILED: Fusing consumer dump_to_pub/Write/NativeWrite into dump_to_pub/ToProtobuf
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.457Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.515Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.548Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.586Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.682Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.718Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:44:34.753Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:45:07.567Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T07:45:20.461Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
WARNING  apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:247 Timing out on waiting for job 2021-09-09_00_44_23-919332740186725729 after 61 seconds
PASSED

=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-noxdist.xml> -
=========== 1 passed, 4991 deselected, 1 warnings in 648.14 seconds ============

> Task :sdks:python:test-suites:dataflow:validatesRunnerStreamingTestsV2

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 54m 16s
84 actionable tasks: 59 executed, 25 from cache

Publishing build scan...
https://gradle.com/s/znb6nt7l4cogk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow_V2 #2453

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2453/display/redirect?page=changes>

Changes:

[noreply] Add display data for JdbcIO.write (#15460)


------------------------------------------
[...truncated 1.54 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:32:41.306Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:32:41.336Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:32:55.161Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:32:55.177Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:33:09.545Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:33:09.570Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:33:23.674Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:33:23.695Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:33:37.558Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:33:37.585Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:33:51.513Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:33:51.534Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:34:05.551Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:34:05.581Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:34:19.460Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:34:19.491Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:34:32.860Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:34:32.890Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     oauth2client.transport:transport.py:183 Refreshing due to a 401 (attempt 1/2)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:34:46.241Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:34:46.260Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:00.484Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:00.508Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:14.404Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:14.429Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:27.736Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:27.773Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:43.319Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:43.355Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:57.833Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:35:57.865Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:36:12.876Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:36:12.900Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:36:27.188Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:36:27.215Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:36:41.131Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:36:41.171Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:36:55.358Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:36:55.380Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:37:08.892Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:37:08.916Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:37:22.189Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:37:22.220Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:37:36.904Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:37:36.964Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:37:49.948Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:37:49.967Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:03.597Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:03.628Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:17.699Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:17.720Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:31.884Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:31.906Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:45.555Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:45.596Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:58.400Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:38:58.423Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:39:12.034Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:39:12.061Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:39:25.124Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:39:25.154Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:39:38.475Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:39:38.512Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:39:52.914Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:39:52.992Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:40:07.547Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:40:07.575Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:40:22.366Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:40:22.392Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:40:36.587Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:40:36.611Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:40:50.480Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:40:50.528Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:41:04.440Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:41:04.469Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:41:18.252Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:41:18.276Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:41:32.072Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:41:32.094Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:41:46.583Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:41:46.608Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:00.224Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:00.303Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:14.297Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:14.327Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:28.147Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:28.198Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:43.107Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:43.148Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:56.834Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:42:56.877Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:43:10.365Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:43:10.382Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:43:24.551Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:43:24.577Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:43:39.177Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:43:39.206Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:43:53.209Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:43:53.227Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:44:07.725Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:44:07.776Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:44:22.491Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:44:22.535Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:44:36.645Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:44:36.673Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:44:50.154Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:44:50.182Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:03.695Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:03.724Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:17.688Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:17.719Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:30.977Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:31.005Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:44.868Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:44.893Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:59.220Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:45:59.241Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:46:13.417Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:46:13.438Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:46:27.895Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:46:27.920Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:46:41.149Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:46:41.184Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:46:54.963Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:46:54.998Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:47:08.945Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:47:09.014Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:47:23.453Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:47:23.470Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:47:37.449Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:47:37.474Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:47:52.004Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:47:52.044Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:48:05.392Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:48:05.420Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:48:19.214Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:48:19.239Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:48:32.933Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:48:32.968Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:48:47.664Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:48:47.686Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:01.358Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:01.386Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:15.404Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:15.428Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:29.737Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:29.757Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:43.883Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:43.904Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:57.479Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:49:57.500Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:50:11.461Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:50:11.486Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:50:25.331Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:50:25.364Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:50:39.281Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:50:39.303Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:50:54.750Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:50:54.797Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:51:08.835Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:51:08.861Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:51:23.009Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:51:23.036Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:51:37.161Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:51:37.179Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:51:50.550Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:51:50.565Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:52:05.299Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:52:05.313Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:52:18.371Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:52:18.389Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:52:32.646Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:52:32.661Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:52:47.083Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:52:47.111Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:00.002Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:00.039Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:14.602Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:14.628Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:28.482Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:28.503Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:41.555Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:41.577Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:55.815Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:53:55.848Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:54:10.117Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded.  Limit: 2000.0 in region us-central1.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-09T01:54:10.137Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-08_17_39_31-14680140319631416403 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
======== 7 failed, 24 passed, 1 skipped, 8 warnings in 5930.17 seconds =========

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 17m 1s
84 actionable tasks: 56 executed, 28 from cache

Publishing build scan...
https://gradle.com/s/rbt6mrp73t27y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org