You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/04 14:27:26 UTC

Build failed in Jenkins: beam_PostCommit_Python37 #4944

See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/4944/display/redirect>

Changes:


------------------------------------------
[...truncated 51.74 MB...]
                                                                           type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:888 Created job with id: [2022-03-04_06_10_01-6107740097004398776]
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:889 Submitted job: 2022-03-04_06_10_01-6107740097004398776
INFO     apache_beam.runners.dataflow.internal.apiclient:apiclient.py:895 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-04_06_10_01-6107740097004398776?project=apache-beam-testing
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2022-03-04_06_10_01-6107740097004398776 is in state JOB_STATE_RUNNING
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:02.502Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2022-03-04_06_10_01-6107740097004398776. The number of workers will be between 1 and 1000.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:05.804Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2022-03-04_06_10_01-6107740097004398776.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:10.295Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-b.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.063Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.103Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.133Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.166Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.196Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.224Z: JOB_MESSAGE_DETAILED: Unzipping flatten s5 for input s3.unbatchable
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.275Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of WriteToSpanner/Writing to spanner, through flatten WriteToSpanner/make batches/Merging batchable and unbatchable, into producer WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.302Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteToSpanner/Writing to spanner into WriteToSpanner/make batches/ParDo(_BatchFn)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.338Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteToSpanner/make batches/Making mutation groups into Create/Read
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.371Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn) into WriteToSpanner/make batches/Making mutation groups
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.398Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteToSpanner/make batches/ParDo(_BatchFn) into WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.425Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.456Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.489Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.524Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.660Z: JOB_MESSAGE_DEBUG: Executing wait step start6
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.727Z: JOB_MESSAGE_BASIC: Executing operation Create/Read+WriteToSpanner/make batches/Making mutation groups+WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to spanner
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.764Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:13.786Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:33.642Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:10:57.385Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:11:24.679Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:11:24.705Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:41.479Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             During handling of the above exception, another exception occurred:
                                                                             
                                                                             Traceback (most recent call last):
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 646, in do_work
                                                                                 work_executor.execute()
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 210, in execute
                                                                                 op.finish()
                                                                               File "apache_beam/runners/worker/operations.py", line 736, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 738, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 739, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/common.py", line 1253, in apache_beam.runners.common.DoFnRunner.finish
                                                                               File "apache_beam/runners/common.py", line 1234, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 1265, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1232, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 475, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 480, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 1401, in apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               File "apache_beam/runners/worker/operations.py", line 215, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               File "apache_beam/runners/worker/operations.py", line 707, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call' [while running 'WriteToSpanner/Writing to spanner']
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:44.265Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             During handling of the above exception, another exception occurred:
                                                                             
                                                                             Traceback (most recent call last):
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 646, in do_work
                                                                                 work_executor.execute()
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 210, in execute
                                                                                 op.finish()
                                                                               File "apache_beam/runners/worker/operations.py", line 736, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 738, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 739, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/common.py", line 1253, in apache_beam.runners.common.DoFnRunner.finish
                                                                               File "apache_beam/runners/common.py", line 1234, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 1265, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1232, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 475, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 480, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 1401, in apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               File "apache_beam/runners/worker/operations.py", line 215, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               File "apache_beam/runners/worker/operations.py", line 707, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call' [while running 'WriteToSpanner/Writing to spanner']
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:47.733Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             During handling of the above exception, another exception occurred:
                                                                             
                                                                             Traceback (most recent call last):
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 646, in do_work
                                                                                 work_executor.execute()
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 210, in execute
                                                                                 op.finish()
                                                                               File "apache_beam/runners/worker/operations.py", line 736, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 738, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 739, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/common.py", line 1253, in apache_beam.runners.common.DoFnRunner.finish
                                                                               File "apache_beam/runners/common.py", line 1234, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 1265, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1232, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 475, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 480, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 1401, in apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               File "apache_beam/runners/worker/operations.py", line 215, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               File "apache_beam/runners/worker/operations.py", line 707, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call' [while running 'WriteToSpanner/Writing to spanner']
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:50.197Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             During handling of the above exception, another exception occurred:
                                                                             
                                                                             Traceback (most recent call last):
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 646, in do_work
                                                                                 work_executor.execute()
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 210, in execute
                                                                                 op.finish()
                                                                               File "apache_beam/runners/worker/operations.py", line 736, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 738, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 739, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/common.py", line 1253, in apache_beam.runners.common.DoFnRunner.finish
                                                                               File "apache_beam/runners/common.py", line 1234, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 1265, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1232, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 475, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 480, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 1401, in apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               File "apache_beam/runners/worker/operations.py", line 215, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               File "apache_beam/runners/worker/operations.py", line 707, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call' [while running 'WriteToSpanner/Writing to spanner']
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:50.225Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+WriteToSpanner/make batches/Making mutation groups+WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to spanner
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:50.289Z: JOB_MESSAGE_DEBUG: Executing failure step failure5
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:50.324Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S01:Create/Read+WriteToSpanner/make batches/Making mutation groups+WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to spanner failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers: 
                                                                             
                                                                               beamapp-jenkins-030414095-03040610-cs07-harness-81sk
                                                                                   Root cause: Work item failed.,
                                                                             
                                                                               beamapp-jenkins-030414095-03040610-cs07-harness-81sk
                                                                                   Root cause: Work item failed.,
                                                                             
                                                                               beamapp-jenkins-030414095-03040610-cs07-harness-81sk
                                                                                   Root cause: Work item failed.,
                                                                             
                                                                               beamapp-jenkins-030414095-03040610-cs07-harness-81sk
                                                                                   Root cause: Work item failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:50.405Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:50.465Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:16:50.500Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:19:12.928Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:19:12.990Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T14:19:13.036Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2022-03-04_06_10_01-6107740097004398776 is in state JOB_STATE_FAILED
=============================== warnings summary ===============================
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:128
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_write_it_test.py:190
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py:117
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py:171
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_write_it_test.py:135
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
======== 1 failed, 4 passed, 10 skipped, 5 warnings in 1676.45 seconds =========

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 144

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:spannerioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 2h 26m 47s
224 actionable tasks: 154 executed, 64 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/c3whjx375floe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python37 #4946

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/4946/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #4945

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/4945/display/redirect?page=changes>

Changes:

[stephen.patel] BEAM-14011 fix s3 filesystem multipart copy

[noreply] Merge pull request #16842 from [BEAM-13932][Playground] Container's user


------------------------------------------
[...truncated 49.47 MB...]
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.336Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteToSpanner/make batches/ParDo(_BatchFn) into WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.374Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.405Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.438Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.514Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.720Z: JOB_MESSAGE_DEBUG: Executing wait step start6
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.838Z: JOB_MESSAGE_BASIC: Executing operation Create/Read+WriteToSpanner/make batches/Making mutation groups+WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to spanner
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.887Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:38.917Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:12:52.275Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:13:26.151Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:13:51.894Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:13:51.957Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:01.889Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             During handling of the above exception, another exception occurred:
                                                                             
                                                                             Traceback (most recent call last):
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 646, in do_work
                                                                                 work_executor.execute()
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 210, in execute
                                                                                 op.finish()
                                                                               File "apache_beam/runners/worker/operations.py", line 736, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 738, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 739, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/common.py", line 1253, in apache_beam.runners.common.DoFnRunner.finish
                                                                               File "apache_beam/runners/common.py", line 1234, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 1265, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1232, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 475, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 480, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 1401, in apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               File "apache_beam/runners/worker/operations.py", line 215, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               File "apache_beam/runners/worker/operations.py", line 707, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call' [while running 'WriteToSpanner/Writing to spanner']
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:06.508Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             During handling of the above exception, another exception occurred:
                                                                             
                                                                             Traceback (most recent call last):
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 646, in do_work
                                                                                 work_executor.execute()
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 210, in execute
                                                                                 op.finish()
                                                                               File "apache_beam/runners/worker/operations.py", line 736, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 738, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 739, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/common.py", line 1253, in apache_beam.runners.common.DoFnRunner.finish
                                                                               File "apache_beam/runners/common.py", line 1234, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 1265, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1232, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 475, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 480, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 1401, in apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               File "apache_beam/runners/worker/operations.py", line 215, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               File "apache_beam/runners/worker/operations.py", line 707, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call' [while running 'WriteToSpanner/Writing to spanner']
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:09.779Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             During handling of the above exception, another exception occurred:
                                                                             
                                                                             Traceback (most recent call last):
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 646, in do_work
                                                                                 work_executor.execute()
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 210, in execute
                                                                                 op.finish()
                                                                               File "apache_beam/runners/worker/operations.py", line 736, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 738, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 739, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/common.py", line 1253, in apache_beam.runners.common.DoFnRunner.finish
                                                                               File "apache_beam/runners/common.py", line 1234, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 1265, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1232, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 475, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 480, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 1401, in apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               File "apache_beam/runners/worker/operations.py", line 215, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               File "apache_beam/runners/worker/operations.py", line 707, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call' [while running 'WriteToSpanner/Writing to spanner']
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:13.107Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             During handling of the above exception, another exception occurred:
                                                                             
                                                                             Traceback (most recent call last):
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 646, in do_work
                                                                                 work_executor.execute()
                                                                               File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 210, in execute
                                                                                 op.finish()
                                                                               File "apache_beam/runners/worker/operations.py", line 736, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 738, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/worker/operations.py", line 739, in apache_beam.runners.worker.operations.DoOperation.finish
                                                                               File "apache_beam/runners/common.py", line 1253, in apache_beam.runners.common.DoFnRunner.finish
                                                                               File "apache_beam/runners/common.py", line 1234, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 1265, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1232, in apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               File "apache_beam/runners/common.py", line 475, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 480, in apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               File "apache_beam/runners/common.py", line 1401, in apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               File "apache_beam/runners/worker/operations.py", line 215, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               File "apache_beam/runners/worker/operations.py", line 707, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
                                                                               File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
                                                                               File "apache_beam/runners/common.py", line 537, in apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py", line 1251, in process
                                                                                 self.service_metric.call('ok')
                                                                             AttributeError: 'NoneType' object has no attribute 'call' [while running 'WriteToSpanner/Writing to spanner']
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:13.133Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+WriteToSpanner/make batches/Making mutation groups+WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to spanner
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:13.205Z: JOB_MESSAGE_DEBUG: Executing failure step failure5
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:13.239Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S01:Create/Read+WriteToSpanner/make batches/Making mutation groups+WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to spanner failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers: 
                                                                             
                                                                               beamapp-jenkins-030420121-03041212-otu2-harness-6pdw
                                                                                   Root cause: Work item failed.,
                                                                             
                                                                               beamapp-jenkins-030420121-03041212-otu2-harness-6pdw
                                                                                   Root cause: Work item failed.,
                                                                             
                                                                               beamapp-jenkins-030420121-03041212-otu2-harness-6pdw
                                                                                   Root cause: Work item failed.,
                                                                             
                                                                               beamapp-jenkins-030420121-03041212-otu2-harness-6pdw
                                                                                   Root cause: Work item failed.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:13.290Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:13.333Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:19:13.360Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:21:36.788Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:21:36.852Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-03-04T20:21:36.884Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2022-03-04_12_12_28-16282451897475920009 is in state JOB_STATE_FAILED
=============================== warnings summary ===============================
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:190
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py:128
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_write_it_test.py:171
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py:117
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py:135
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
======== 1 failed, 4 passed, 10 skipped, 5 warnings in 1634.98 seconds =========

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 120

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 144

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:spannerioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 2h 29m 52s
224 actionable tasks: 155 executed, 63 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/ib2bf5dv4te3w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org