You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/01/08 00:12:39 UTC

Build failed in Jenkins: beam_PostCommit_Python37 #6178

See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6178/display/redirect>

Changes:


------------------------------------------
[...truncated 16.28 MB...]
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/fileio.py>:591: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1684: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    streaming = self.test_pipeline.options.view_as(StandardOptions).streaming

apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:172: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_deidentification
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:77: FutureWarning: MaskDetectedDetails is experimental.
    inspection_config=INSPECT_CONFIG))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_inspection
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:87: FutureWarning: InspectForDetails is experimental.
    | beam.ParDo(extract_inspection_results).with_outputs(

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>:129: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    model_file_type=ModelFileType.PICKLE, model_uri=model_filename)

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/dill/_dill.py>:472: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    obj = StockUnpickler.load(self)

apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:695: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:810: FutureWarning: ReadAllFromBigQuery is experimental.
    | beam.io.ReadAllFromBigQuery())

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2659: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2672: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    options=pcoll.pipeline.options,

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/io/gcp/bigquery_json_it_test.py::BigQueryJsonIT::test_query_read - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}], unexpected elements [{'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 287, in _execute
    response = task()
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1004, in process_bundle
    element.data)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 227, in process_encoded
    self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 526, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}], unexpected elements [{'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] [while running 'assert_that/Match-ptransform-43']
===== 1 failed, 84 passed, 21 skipped, 225 warnings in 14994.42s (4:09:54) =====

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=spannerio_it
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, hypothesis-6.61.2, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15] / gw7 [15]

scheduling tests via LoadFileScheduling

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 

=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========== 5 passed, 16 skipped, 14 warnings in 2340.13s (0:39:00) ============

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 111

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 4h 51m 57s
213 actionable tasks: 149 executed, 58 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/3rdffdep4d4hw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python37 #6185

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6185/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #6184

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6184/display/redirect>

Changes:


------------------------------------------
[...truncated 16.12 MB...]
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/fileio.py>:591: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1684: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    streaming = self.test_pipeline.options.view_as(StandardOptions).streaming

apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:172: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_deidentification
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:77: FutureWarning: MaskDetectedDetails is experimental.
    inspection_config=INSPECT_CONFIG))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_inspection
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:87: FutureWarning: InspectForDetails is experimental.
    | beam.ParDo(extract_inspection_results).with_outputs(

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>:129: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    model_file_type=ModelFileType.PICKLE, model_uri=model_filename)

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/dill/_dill.py>:472: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    obj = StockUnpickler.load(self)

apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:695: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:810: FutureWarning: ReadAllFromBigQuery is experimental.
    | beam.io.ReadAllFromBigQuery())

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2659: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2672: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    options=pcoll.pipeline.options,

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/io/gcp/bigquery_json_it_test.py::BigQueryJsonIT::test_query_read - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}], unexpected elements [{'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 287, in _execute
    response = task()
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1004, in process_bundle
    element.data)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 227, in process_encoded
    self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 526, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}], unexpected elements [{'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] [while running 'assert_that/Match-ptransform-43']
===== 1 failed, 84 passed, 21 skipped, 225 warnings in 13673.76s (3:47:53) =====

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=spannerio_it
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0, hypothesis-6.62.0
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15] / gw7 [15]

scheduling tests via LoadFileScheduling

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 

=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========== 5 passed, 16 skipped, 14 warnings in 2105.96s (0:35:05) ============

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 111

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 4h 25m 27s
213 actionable tasks: 149 executed, 58 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/wgoxiif4ydz3k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #6183

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6183/display/redirect>

Changes:


------------------------------------------
[...truncated 16.09 MB...]
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/fileio.py>:591: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1684: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    streaming = self.test_pipeline.options.view_as(StandardOptions).streaming

apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:172: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_deidentification
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:77: FutureWarning: MaskDetectedDetails is experimental.
    inspection_config=INSPECT_CONFIG))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_inspection
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:87: FutureWarning: InspectForDetails is experimental.
    | beam.ParDo(extract_inspection_results).with_outputs(

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>:129: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    model_file_type=ModelFileType.PICKLE, model_uri=model_filename)

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/dill/_dill.py>:472: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    obj = StockUnpickler.load(self)

apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:695: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:810: FutureWarning: ReadAllFromBigQuery is experimental.
    | beam.io.ReadAllFromBigQuery())

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2659: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2672: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    options=pcoll.pipeline.options,

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/io/gcp/bigquery_json_it_test.py::BigQueryJsonIT::test_query_read - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}], unexpected elements [{'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 287, in _execute
    response = task()
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1004, in process_bundle
    element.data)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 227, in process_encoded
    self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 526, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}], unexpected elements [{'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] [while running 'assert_that/Match-ptransform-43']
===== 1 failed, 84 passed, 21 skipped, 225 warnings in 14786.64s (4:06:26) =====

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=spannerio_it
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0, hypothesis-6.62.0
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15] / gw7 [15]

scheduling tests via LoadFileScheduling

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 

=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========== 5 passed, 16 skipped, 14 warnings in 2212.96s (0:36:52) ============

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 111

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 4h 45m 18s
213 actionable tasks: 149 executed, 58 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/vcpvzwwjo7su4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #6182

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6182/display/redirect?page=changes>

Changes:

[noreply] [#24927] Ensure the SDK harness handles JCL/log4j/log4j2 messages.


------------------------------------------
[...truncated 15.60 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:51 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 2-30
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:51 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 2-24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:51 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 2-26
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:51 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 2-25
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:51 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 2-42
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:51 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Beam Fn Data client connected.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:52 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Connecting to SpannerConfig{projectId=beam-testing, instanceId=beam-test, databaseId=xlang_beam693a7654826941ff86c0, host=https://batch-spanner.googleapis.com/, emulatorHost=http://localhost:35685, isLocalChannelProvider=null, commitDeadline=PT15S, maxCumulativeBackoff=PT900S, executeStreamingSqlRetrySettings=null, commitRetrySettings=null, retryableCodes=null, rpcPriority=MEDIUM, databaseRole=null, serviceFactory=null}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:53 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing environment urn: "beam:env:external:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n\021\n\017localhost:35279"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:264 No more requests from control plane
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:265 SDK Harness waiting for in-flight requests to complete
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
INFO     apache_beam.runners.worker.data_plane:data_plane.py:805 Closing all cached grpc data channels.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1"
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:875 Closing all cached gRPC state handlers.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:277 Done consuming work.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v0"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:worker_status:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:combinefn:packed_python:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.45.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:53 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:53 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing environment urn: "beam:env:docker:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n apache/beam_java8_sdk:2.45.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:multi_core_bundle_processing:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:control_request_elements_embedding:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:state_caching:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.45.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 dependencies {
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   type_urn: "beam:artifact:type:file:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   type_payload: "\n\316\001/tmp/beam-templ8w8ha85/artifactstf0wnllz/032638b77f2b99bff378c6b4bd529b301beee765f9642f84fc8656adf363eba9/1-external_7beam:env:docker-beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHO"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   role_urn: "beam:artifact:role:staging_to:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   role_payload: "\nybeam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:53 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 1 Beam Fn Logging clients still connected during shutdown.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:53 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 7:45:53 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing Docker container 28d8c6e679ae51d93bbfcd8b8073b04439bc3a2016ba2351c86dfe5e8d6655d6. Logs:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 19:45:47 Provision info:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1"  value:{bool_value:false}}  fields:{key:"beam:option:allow_non_restored_state:v1"  value:{bool_value:false}}  fields:{key:"beam:option:allow_unsafe_triggers:v1"  value:{bool_value:false}}  fields:{key:"beam:option:app_name:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:artifact_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:auto_balance_write_files_sharding_enabled:v1"  value:{bool_value:false}}  fields:{key:"beam:option:beam_services:v1"  value:{struct_value:{}}}  fields:{key:"beam:option:block_on_run:v1"  value:{bool_value:true}}  fields:{key:"beam:option:dataflow_endpoint:v1"  value:{string_value:"https://dataflow.googleapis.com"}}  fields:{key:"beam:option:direct_embed_docker_python:v1"  value:{bool_value:false}}  fields:{key:"beam:option:direct_num_workers:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:direct_runner_bundle_repeat:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1"  value:{bool_value:true}}  fields:{key:"beam:option:direct_running_mode:v1"  value:{string_value:"in_memory"}}  fields:{key:"beam:option:direct_test_splits:v1"  value:{struct_value:{}}}  fields:{key:"beam:option:disable_metrics:v1"  value:{bool_value:false}}  fields:{key:"beam:option:dry_run:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_artifact_caching:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_hot_key_logging:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_streaming_engine:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enforce_encodability:v1"  value:{bool_value:true}}  fields:{key:"beam:option:enforce_immutability:v1"  value:{bool_value:true}}  fields:{key:"beam:option:environment_cache_millis:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:environment_config:v1"  value:{string_value:"localhost:35279"}}  fields:{key:"beam:option:environment_type:v1"  value:{string_value:"LOOPBACK"}}  fields:{key:"beam:option:expansion_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:experiments:v1"  value:{list_value:{values:{string_value:"beam_fn_api"}}}}  fields:{key:"beam:option:externalized_checkpoints_enabled:v1"  value:{bool_value:false}}  fields:{key:"beam:option:fail_on_checkpointing_errors:v1"  value:{bool_value:true}}  fields:{key:"beam:option:faster_copy:v1"  value:{bool_value:false}}  fields:{key:"beam:option:finish_bundle_before_checkpointing:v1"  value:{bool_value:false}}  fields:{key:"beam:option:flink_conf_dir:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:flink_job_server_jar:v1"  value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.45.0-SNAPSHOT.jar"}}>  fields:{key:"beam:option:flink_master:v1"  value:{string_value:"[auto]"}}  fields:{key:"beam:option:flink_submit_uber_jar:v1"  value:{bool_value:false}}  fields:{key:"beam:option:flink_version:v1"  value:{string_value:"1.15"}}  fields:{key:"beam:option:gcp_oauth_scopes:v1"  value:{list_value:{values:{string_value:"https://www.googleapis.com/auth/bigquery"}  values:{string_value:"https://www.googleapis.com/auth/cloud-platform"}  values:{string_value:"https://www.googleapis.com/auth/devstorage.full_control"}  values:{string_value:"https://www.googleapis.com/auth/userinfo.email"}  values:{string_value:"https://www.googleapis.com/auth/datastore"}  values:{string_value:"https://www.googleapis.com/auth/spanner.admin"}  values:{string_value:"https://www.googleapis.com/auth/spanner.data"}}}}  fields:{key:"beam:option:gcs_performance_metrics:v1"  value:{bool_value:false}}  fields:{key:"beam:option:hdfs_full_urls:v1"  value:{bool_value:false}}  fields:{key:"beam:option:job_name:v1"  value:{string_value:"BeamApp-jenkins-0108194532-7c70ded8"}}  fields:{key:"beam:option:job_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:job_server_java_launcher:v1"  value:{string_value:"java"}}  fields:{key:"beam:option:job_server_jvm_properties:v1"  value:{list_value:{}}}  fields:{key:"beam:option:job_server_timeout:v1"  value:{string_value:"60"}}  fields:{key:"beam:option:load_balance_bundles:v1"  value:{bool_value:false}}  fields:{key:"beam:option:max_parallelism:v1"  value:{string_value:"-1"}}  fields:{key:"beam:option:no_auth:v1"  value:{bool_value:false}}  fields:{key:"beam:option:object_reuse:v1"  value:{bool_value:false}}  fields:{key:"beam:option:options_id:v1"  value:{number_value:2}}  fields:{key:"beam:option:output_executable_path:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:parallelism:v1"  value:{string_value:"-1"}}  fields:{key:"beam:option:performance_runtime_type_check:v1"  value:{bool_value:false}}  fields:{key:"beam:option:pickle_library:v1"  value:{string_value:"default"}}  fields:{key:"beam:option:pipeline_type_check:v1"  value:{bool_value:true}}  fields:{key:"beam:option:profile_cpu:v1"  value:{bool_value:false}}  fields:{key:"beam:option:profile_memory:v1"  value:{bool_value:false}}  fields:{key:"beam:option:profile_sample_rate:v1"  value:{number_value:1}}  fields:{key:"beam:option:project:v1"  value:{string_value:"apache-beam-testing"}}  fields:{key:"beam:option:re_iterable_group_by_key_result:v1"  value:{bool_value:false}}  fields:{key:"beam:option:requirements_cache_only_sources:v1"  value:{bool_value:false}}  fields:{key:"beam:option:resource_hints:v1"  value:{list_value:{}}}  fields:{key:"beam:option:retain_docker_containers:v1"  value:{bool_value:false}}  fields:{key:"beam:option:retain_externalized_checkpoints_on_cancellation:v1"  value:{bool_value:false}}  fields:{key:"beam:option:runner:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:runner_determined_sharding:v1"  value:{bool_value:true}}  fields:{key:"beam:option:runtime_type_check:v1"  value:{bool_value:false}}  fields:{key:"beam:option:s3_disable_ssl:v1"  value:{bool_value:false}}  fields:{key:"beam:option:save_main_session:v1"  value:{bool_value:false}}  fields:{key:"beam:option:sdk_harness_log_level_overrides:v1"  value:{struct_value:{fields:{key:"org.apache.beam.runners.flink.FlinkPipelineRunner"  value:{string_value:"WARN"}}  fields:{key:"org.apache.flink.runtime"  value:{string_value:"WARN"}}  fields:{key:"org.apache.flink.runtime.metrics.groups"  value:{string_value:"ERROR"}}}}}  fields:{key:"beam:option:sdk_location:v1"  value:{string_value:"container"}}  fields:{key:"beam:option:sdk_worker_parallelism:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:spark_master_url:v1"  value:{string_value:"local[4]"}}  fields:{key:"beam:option:spark_submit_uber_jar:v1"  value:{bool_value:false}}  fields:{key:"beam:option:spark_version:v1"  value:{string_value:"3"}}  fields:{key:"beam:option:streaming:v1"  value:{bool_value:false}}  fields:{key:"beam:option:temp_location:v1"  value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-it"}}  fields:{key:"beam:option:type_check_additional:v1"  value:{string_value:""}}  fields:{key:"beam:option:type_check_strictness:v1"  value:{string_value:"DEFAULT_TO_ANY"}}  fields:{key:"beam:option:update:v1"  value:{bool_value:false}}  fields:{key:"beam:option:use_storage_api_connection_pool:v1"  value:{bool_value:false}}  fields:{key:"beam:option:use_storage_write_api:v1"  value:{bool_value:false}}  fields:{key:"beam:option:use_storage_write_api_at_least_once:v1"  value:{bool_value:false}}  fields:{key:"beam:option:verify_row_values:v1"  value:{bool_value:false}}}  logging_endpoint:{url:"localhost:38499"}  artifact_endpoint:{url:"localhost:39629"}  control_endpoint:{url:"localhost:45325"}  dependencies:{type_urn:"beam:artifact:type:file:v1"  type_payload:"\n\xce\x01/tmp/beam-templ8w8ha85/artifactstf0wnllz/032638b77f2b99bff378c6b4bd529b301beee765f9642f84fc8656adf363eba9/1-external_7beam:env:docker-beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHO"  role_urn:"beam:artifact:role:staging_to:v1"  role_payload:"\nybeam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar"}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 19:45:47 Initializing java harness: /opt/apache/beam/boot --id=2-1 --provision_endpoint=localhost:44803
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 19:45:48 Downloaded: /tmp/2-1/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar (sha256: 8340621760cfcd3d361b353e59e09634836d2210a9d0271395c3fb1c86bf654b, size: 115595880)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 19:45:48 Loaded meta-option 'java-security'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 19:45:48 Executing: java -Xmx76799219302 -XX:+UseParallelGC -XX:+AlwaysActAsServerClassMachine -XX:-OmitStackTraceInFastThrow -cp /opt/apache/beam/jars/slf4j-api.jar:/opt/apache/beam/jars/slf4j-jdk14.jar:/opt/apache/beam/jars/jcl-over-slf4j.jar:/opt/apache/beam/jars/log4j-over-slf4j.jar:/opt/apache/beam/jars/log4j-to-slf4j.jar:/opt/apache/beam/jars/beam-sdks-java-harness.jar:/opt/apache/beam/jars/beam-sdks-java-io-kafka.jar:/opt/apache/beam/jars/kafka-clients.jar:/tmp/2-1/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar -javaagent:/opt/apache/beam/jars/jamm.jar -Djava.security.properties=/opt/apache/beam/options/java8-security.properties org.apache.beam.fn.harness.FnHarness
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Class path contains multiple SLF4J bindings.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Found binding in [jar:file:/opt/apache/beam/jars/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Found binding in [jar:file:/tmp/2-1/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SDK Fn Harness started
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Harness ID 2-1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Logging location url: "localhost:38499"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Control location url: "localhost:45325"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Status location null
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Pipeline options {"beam:option:allow_non_deterministic_key_coders:v1":false,"beam:option:allow_non_restored_state:v1":false,"beam:option:allow_unsafe_triggers:v1":false,"beam:option:app_name:v1":null,"beam:option:artifact_port:v1":"0","beam:option:auto_balance_write_files_sharding_enabled:v1":false,"beam:option:beam_services:v1":{},"beam:option:block_on_run:v1":true,"beam:option:dataflow_endpoint:v1":"https://dataflow.googleapis.com","beam:option:direct_embed_docker_python:v1":false,"beam:option:direct_num_workers:v1":"1","beam:option:direct_runner_bundle_repeat:v1":"0","beam:option:direct_runner_use_stacked_bundle:v1":true,"beam:option:direct_running_mode:v1":"in_memory","beam:option:direct_test_splits:v1":{},"beam:option:disable_metrics:v1":false,"beam:option:dry_run:v1":false,"beam:option:enable_artifact_caching:v1":false,"beam:option:enable_hot_key_logging:v1":false,"beam:option:enable_streaming_engine:v1":false,"beam:option:enforce_encodability:v1":true,"beam:option:enforce_immutability:v1":true,"beam:option:environment_cache_millis:v1":"0","beam:option:environment_config:v1":"localhost:35279","beam:option:environment_type:v1":"LOOPBACK","beam:option:expansion_port:v1":"0","beam:option:experiments:v1":["beam_fn_api"],"beam:option:externalized_checkpoints_enabled:v1":false,"beam:option:fail_on_checkpointing_errors:v1":true,"beam:option:faster_copy:v1":false,"beam:option:finish_bundle_before_checkpointing:v1":false,"beam:option:flink_conf_dir:v1":null,"beam:option:flink_job_server_jar:v1":"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.45.0-SNAPSHOT.jar","beam>:option:flink_master:v1":"[auto]","beam:option:flink_submit_uber_jar:v1":false,"beam:option:flink_version:v1":"1.15","beam:option:gcp_oauth_scopes:v1":["https://www.googleapis.com/auth/bigquery","https://www.googleapis.com/auth/cloud-platform","https://www.googleapis.com/auth/devstorage.full_control","https://www.googleapis.com/auth/userinfo.email","https://www.googleapis.com/auth/datastore","https://www.googleapis.com/auth/spanner.admin","https://www.googleapis.com/auth/spanner.data"],"beam:option:gcs_performance_metrics:v1":false,"beam:option:hdfs_full_urls:v1":false,"beam:option:job_name:v1":"BeamApp-jenkins-0108194532-7c70ded8","beam:option:job_port:v1":"0","beam:option:job_server_java_launcher:v1":"java","beam:option:job_server_jvm_properties:v1":[],"beam:option:job_server_timeout:v1":"60","beam:option:load_balance_bundles:v1":false,"beam:option:max_parallelism:v1":"-1","beam:option:no_auth:v1":false,"beam:option:object_reuse:v1":false,"beam:option:options_id:v1":2,"beam:option:output_executable_path:v1":null,"beam:option:parallelism:v1":"-1","beam:option:performance_runtime_type_check:v1":false,"beam:option:pickle_library:v1":"default","beam:option:pipeline_type_check:v1":true,"beam:option:profile_cpu:v1":false,"beam:option:profile_memory:v1":false,"beam:option:profile_sample_rate:v1":1,"beam:option:project:v1":"apache-beam-testing","beam:option:re_iterable_group_by_key_result:v1":false,"beam:option:requirements_cache_only_sources:v1":false,"beam:option:resource_hints:v1":[],"beam:option:retain_docker_containers:v1":false,"beam:option:retain_externalized_checkpoints_on_cancellation:v1":false,"beam:option:runner:v1":null,"beam:option:runner_determined_sharding:v1":true,"beam:option:runtime_type_check:v1":false,"beam:option:s3_disable_ssl:v1":false,"beam:option:save_main_session:v1":false,"beam:option:sdk_harness_log_level_overrides:v1":{"org.apache.beam.runners.flink.FlinkPipelineRunner":"WARN","org.apache.flink.runtime":"WARN","org.apache.flink.runtime.metrics.groups":"ERROR"},"beam:option:sdk_location:v1":"container","beam:option:sdk_worker_parallelism:v1":"1","beam:option:spark_master_url:v1":"local[4]","beam:option:spark_submit_uber_jar:v1":false,"beam:option:spark_version:v1":"3","beam:option:streaming:v1":false,"beam:option:temp_location:v1":"gs://temp-storage-for-end-to-end-tests/temp-it","beam:option:type_check_additional:v1":"","beam:option:type_check_strictness:v1":"DEFAULT_TO_ANY","beam:option:update:v1":false,"beam:option:use_storage_api_connection_pool:v1":false,"beam:option:use_storage_write_api:v1":false,"beam:option:use_storage_write_api_at_least_once:v1":false,"beam:option:verify_row_values:v1":false}
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED                                                                   [100%]

=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-flink-py37.xml> -
=================== 7 passed, 1 warning in 241.06s (0:04:01) ===================

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=spannerio_it
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0, hypothesis-6.62.0
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15] / gw7 [15]

scheduling tests via LoadFileScheduling

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 

=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========== 5 passed, 16 skipped, 14 warnings in 2270.37s (0:37:50) ============

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 111

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 4h 54m 3s
213 actionable tasks: 183 executed, 24 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/3hbbweulcjtsq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #6181

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6181/display/redirect>

Changes:


------------------------------------------
[...truncated 15.66 MB...]
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/fileio.py>:591: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1684: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    streaming = self.test_pipeline.options.view_as(StandardOptions).streaming

apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:172: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_deidentification
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:77: FutureWarning: MaskDetectedDetails is experimental.
    inspection_config=INSPECT_CONFIG))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_inspection
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:87: FutureWarning: InspectForDetails is experimental.
    | beam.ParDo(extract_inspection_results).with_outputs(

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>:129: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    model_file_type=ModelFileType.PICKLE, model_uri=model_filename)

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/dill/_dill.py>:472: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    obj = StockUnpickler.load(self)

apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:695: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:810: FutureWarning: ReadAllFromBigQuery is experimental.
    | beam.io.ReadAllFromBigQuery())

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2659: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2672: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    options=pcoll.pipeline.options,

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/io/gcp/bigquery_json_it_test.py::BigQueryJsonIT::test_query_read - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}], unexpected elements [{'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 287, in _execute
    response = task()
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1004, in process_bundle
    element.data)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 227, in process_encoded
    self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 526, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}], unexpected elements [{'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] [while running 'assert_that/Match-ptransform-43']
===== 1 failed, 84 passed, 21 skipped, 225 warnings in 14549.88s (4:02:29) =====

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=spannerio_it
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, hypothesis-6.61.3, requests-mock-1.10.0
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15] / gw7 [15]

scheduling tests via LoadFileScheduling

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
[gw2] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
[gw2] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
[gw2] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw2] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 
[gw2] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 

=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========== 5 passed, 16 skipped, 14 warnings in 2285.81s (0:38:05) ============

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 111

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 4h 42m 41s
213 actionable tasks: 149 executed, 58 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/oh2iqqal6ifzo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #6180

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6180/display/redirect>

Changes:


------------------------------------------
[...truncated 16.02 MB...]
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/fileio.py>:591: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1684: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    streaming = self.test_pipeline.options.view_as(StandardOptions).streaming

apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:172: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_deidentification
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:77: FutureWarning: MaskDetectedDetails is experimental.
    inspection_config=INSPECT_CONFIG))

apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_inspection
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:87: FutureWarning: InspectForDetails is experimental.
    | beam.ParDo(extract_inspection_results).with_outputs(

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>:129: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    model_file_type=ModelFileType.PICKLE, model_uri=model_filename)

apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/dill/_dill.py>:472: FutureWarning: SklearnModelHandlerPandas is experimental. No backwards-compatibility guarantees.
    obj = StockUnpickler.load(self)

apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:695: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:810: FutureWarning: ReadAllFromBigQuery is experimental.
    | beam.io.ReadAllFromBigQuery())

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2658: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2659: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project

apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2672: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    options=pcoll.pipeline.options,

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/io/gcp/bigquery_json_it_test.py::BigQueryJsonIT::test_query_read - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}], unexpected elements [{'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 287, in _execute
    response = task()
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1004, in process_bundle
    element.data)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py", line 227, in process_encoded
    self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 526, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1898, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] == [{'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}], unexpected elements [{'country_code': 'special', 'past_leader': None, 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}, {'country_code': 'aus', 'past_leader': None, 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'usa', 'past_leader': None, 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}], missing elements [{'country_code': 'usa', 'past_leader': '"George W. Bush"', 'gdp': '58559.675', 'city_name': '"Los Angeles"', 'landmark_name': '"Golden Gate Bridge"'}, {'country_code': 'aus', 'past_leader': '"Kevin Rudd"', 'gdp': '58043.581', 'city_name': '"Melbourne"', 'landmark_name': '"Great Barrier Reef"'}, {'country_code': 'special', 'past_leader': '"!@#$%^&*()_+"', 'gdp': '421.7', 'city_name': '"Bikini Bottom"', 'landmark_name': '"Willy Wonka\'s Factory"'}] [while running 'assert_that/Match-ptransform-43']
===== 1 failed, 84 passed, 21 skipped, 225 warnings in 14570.71s (4:02:50) =====

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=spannerio_it
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, hypothesis-6.61.3, requests-mock-1.10.0
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15] / gw7 [15]

scheduling tests via LoadFileScheduling

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
[gw2] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
[gw2] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
[gw2] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw2] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 
[gw2] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 

=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========== 5 passed, 16 skipped, 14 warnings in 2448.61s (0:40:48) ============

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 111

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 4h 45m 45s
213 actionable tasks: 149 executed, 58 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/7canfkigqcjvw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #6179

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6179/display/redirect>

Changes:


------------------------------------------
[...truncated 15.90 MB...]
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:277 Done consuming work.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:worker_status:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:combinefn:packed_python:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.45.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 1:41:27 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 1:41:27 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing environment urn: "beam:env:docker:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n apache/beam_java8_sdk:2.45.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:multi_core_bundle_processing:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:control_request_elements_embedding:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:state_caching:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.45.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 dependencies {
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   type_urn: "beam:artifact:type:file:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   type_payload: "\n\316\001/tmp/beam-tempc4on5hs9/artifactsu1ucn4dw/ae7fd1c4e93f84817154ccf3f5f1051766caf69557432959dccd54853c8eefd6/1-external_7beam:env:docker-beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHO"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   role_urn: "beam:artifact:role:staging_to:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   role_payload: "\nybeam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 1:41:27 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 1 Beam Fn Logging clients still connected during shutdown.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 1:41:27 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08, 2023 1:41:27 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing Docker container 2e412de9341dcb2e89c8140c240834c376874cdb5685ce0051bcc45b76cd4b86. Logs:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 01:41:21 Provision info:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1"  value:{bool_value:false}}  fields:{key:"beam:option:allow_non_restored_state:v1"  value:{bool_value:false}}  fields:{key:"beam:option:allow_unsafe_triggers:v1"  value:{bool_value:false}}  fields:{key:"beam:option:app_name:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:artifact_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:auto_balance_write_files_sharding_enabled:v1"  value:{bool_value:false}}  fields:{key:"beam:option:beam_services:v1"  value:{struct_value:{}}}  fields:{key:"beam:option:block_on_run:v1"  value:{bool_value:true}}  fields:{key:"beam:option:dataflow_endpoint:v1"  value:{string_value:"https://dataflow.googleapis.com"}}  fields:{key:"beam:option:direct_embed_docker_python:v1"  value:{bool_value:false}}  fields:{key:"beam:option:direct_num_workers:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:direct_runner_bundle_repeat:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1"  value:{bool_value:true}}  fields:{key:"beam:option:direct_running_mode:v1"  value:{string_value:"in_memory"}}  fields:{key:"beam:option:direct_test_splits:v1"  value:{struct_value:{}}}  fields:{key:"beam:option:disable_metrics:v1"  value:{bool_value:false}}  fields:{key:"beam:option:dry_run:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_artifact_caching:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_hot_key_logging:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_streaming_engine:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enforce_encodability:v1"  value:{bool_value:true}}  fields:{key:"beam:option:enforce_immutability:v1"  value:{bool_value:true}}  fields:{key:"beam:option:environment_cache_millis:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:environment_config:v1"  value:{string_value:"localhost:44379"}}  fields:{key:"beam:option:environment_type:v1"  value:{string_value:"LOOPBACK"}}  fields:{key:"beam:option:expansion_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:experiments:v1"  value:{list_value:{values:{string_value:"beam_fn_api"}}}}  fields:{key:"beam:option:externalized_checkpoints_enabled:v1"  value:{bool_value:false}}  fields:{key:"beam:option:fail_on_checkpointing_errors:v1"  value:{bool_value:true}}  fields:{key:"beam:option:faster_copy:v1"  value:{bool_value:false}}  fields:{key:"beam:option:finish_bundle_before_checkpointing:v1"  value:{bool_value:false}}  fields:{key:"beam:option:flink_conf_dir:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:flink_job_server_jar:v1"  value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.45.0-SNAPSHOT.jar"}}>  fields:{key:"beam:option:flink_master:v1"  value:{string_value:"[auto]"}}  fields:{key:"beam:option:flink_submit_uber_jar:v1"  value:{bool_value:false}}  fields:{key:"beam:option:flink_version:v1"  value:{string_value:"1.15"}}  fields:{key:"beam:option:gcp_oauth_scopes:v1"  value:{list_value:{values:{string_value:"https://www.googleapis.com/auth/bigquery"}  values:{string_value:"https://www.googleapis.com/auth/cloud-platform"}  values:{string_value:"https://www.googleapis.com/auth/devstorage.full_control"}  values:{string_value:"https://www.googleapis.com/auth/userinfo.email"}  values:{string_value:"https://www.googleapis.com/auth/datastore"}  values:{string_value:"https://www.googleapis.com/auth/spanner.admin"}  values:{string_value:"https://www.googleapis.com/auth/spanner.data"}}}}  fields:{key:"beam:option:gcs_performance_metrics:v1"  value:{bool_value:false}}  fields:{key:"beam:option:hdfs_full_urls:v1"  value:{bool_value:false}}  fields:{key:"beam:option:job_name:v1"  value:{string_value:"BeamApp-jenkins-0108014105-e7a442a0"}}  fields:{key:"beam:option:job_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:job_server_java_launcher:v1"  value:{string_value:"java"}}  fields:{key:"beam:option:job_server_jvm_properties:v1"  value:{list_value:{}}}  fields:{key:"beam:option:job_server_timeout:v1"  value:{string_value:"60"}}  fields:{key:"beam:option:load_balance_bundles:v1"  value:{bool_value:false}}  fields:{key:"beam:option:max_parallelism:v1"  value:{string_value:"-1"}}  fields:{key:"beam:option:no_auth:v1"  value:{bool_value:false}}  fields:{key:"beam:option:object_reuse:v1"  value:{bool_value:false}}  fields:{key:"beam:option:options_id:v1"  value:{number_value:2}}  fields:{key:"beam:option:output_executable_path:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:parallelism:v1"  value:{string_value:"-1"}}  fields:{key:"beam:option:performance_runtime_type_check:v1"  value:{bool_value:false}}  fields:{key:"beam:option:pickle_library:v1"  value:{string_value:"default"}}  fields:{key:"beam:option:pipeline_type_check:v1"  value:{bool_value:true}}  fields:{key:"beam:option:profile_cpu:v1"  value:{bool_value:false}}  fields:{key:"beam:option:profile_memory:v1"  value:{bool_value:false}}  fields:{key:"beam:option:profile_sample_rate:v1"  value:{number_value:1}}  fields:{key:"beam:option:project:v1"  value:{string_value:"apache-beam-testing"}}  fields:{key:"beam:option:re_iterable_group_by_key_result:v1"  value:{bool_value:false}}  fields:{key:"beam:option:requirements_cache_only_sources:v1"  value:{bool_value:false}}  fields:{key:"beam:option:resource_hints:v1"  value:{list_value:{}}}  fields:{key:"beam:option:retain_docker_containers:v1"  value:{bool_value:false}}  fields:{key:"beam:option:retain_externalized_checkpoints_on_cancellation:v1"  value:{bool_value:false}}  fields:{key:"beam:option:runner:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:runner_determined_sharding:v1"  value:{bool_value:true}}  fields:{key:"beam:option:runtime_type_check:v1"  value:{bool_value:false}}  fields:{key:"beam:option:s3_disable_ssl:v1"  value:{bool_value:false}}  fields:{key:"beam:option:save_main_session:v1"  value:{bool_value:false}}  fields:{key:"beam:option:sdk_harness_log_level_overrides:v1"  value:{struct_value:{fields:{key:"org.apache.beam.runners.flink.FlinkPipelineRunner"  value:{string_value:"WARN"}}  fields:{key:"org.apache.flink.runtime"  value:{string_value:"WARN"}}  fields:{key:"org.apache.flink.runtime.metrics.groups"  value:{string_value:"ERROR"}}}}}  fields:{key:"beam:option:sdk_location:v1"  value:{string_value:"container"}}  fields:{key:"beam:option:sdk_worker_parallelism:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:spark_master_url:v1"  value:{string_value:"local[4]"}}  fields:{key:"beam:option:spark_submit_uber_jar:v1"  value:{bool_value:false}}  fields:{key:"beam:option:spark_version:v1"  value:{string_value:"3"}}  fields:{key:"beam:option:streaming:v1"  value:{bool_value:false}}  fields:{key:"beam:option:temp_location:v1"  value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-it"}}  fields:{key:"beam:option:type_check_additional:v1"  value:{string_value:""}}  fields:{key:"beam:option:type_check_strictness:v1"  value:{string_value:"DEFAULT_TO_ANY"}}  fields:{key:"beam:option:update:v1"  value:{bool_value:false}}  fields:{key:"beam:option:use_storage_api_connection_pool:v1"  value:{bool_value:false}}  fields:{key:"beam:option:use_storage_write_api:v1"  value:{bool_value:false}}  fields:{key:"beam:option:use_storage_write_api_at_least_once:v1"  value:{bool_value:false}}  fields:{key:"beam:option:verify_row_values:v1"  value:{bool_value:false}}}  logging_endpoint:{url:"localhost:36513"}  artifact_endpoint:{url:"localhost:44723"}  control_endpoint:{url:"localhost:40441"}  dependencies:{type_urn:"beam:artifact:type:file:v1"  type_payload:"\n\xce\x01/tmp/beam-tempc4on5hs9/artifactsu1ucn4dw/ae7fd1c4e93f84817154ccf3f5f1051766caf69557432959dccd54853c8eefd6/1-external_7beam:env:docker-beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHO"  role_urn:"beam:artifact:role:staging_to:v1"  role_payload:"\nybeam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar"}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 01:41:21 Initializing java harness: /opt/apache/beam/boot --id=2-2 --provision_endpoint=localhost:43265
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 01:41:22 Downloaded: /tmp/2-2/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar (sha256: 8340621760cfcd3d361b353e59e09634836d2210a9d0271395c3fb1c86bf654b, size: 115595880)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 01:41:22 Loaded meta-option 'java-security'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/01/08 01:41:22 Executing: java -Xmx76799219302 -XX:+UseParallelGC -XX:+AlwaysActAsServerClassMachine -XX:-OmitStackTraceInFastThrow -cp /opt/apache/beam/jars/slf4j-api.jar:/opt/apache/beam/jars/slf4j-jdk14.jar:/opt/apache/beam/jars/beam-sdks-java-harness.jar:/opt/apache/beam/jars/beam-sdks-java-io-kafka.jar:/opt/apache/beam/jars/kafka-clients.jar:/tmp/2-2/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar -javaagent:/opt/apache/beam/jars/jamm.jar -Djava.security.properties=/opt/apache/beam/options/java8-security.properties org.apache.beam.fn.harness.FnHarness
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Class path contains multiple SLF4J bindings.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Found binding in [jar:file:/opt/apache/beam/jars/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Found binding in [jar:file:/tmp/2-2/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-g0BiF2DPzT02GzU-WeCWNINtIhCp0CcTlcP7HIa_ZUs.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SDK Fn Harness started
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Harness ID 2-2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Logging location url: "localhost:36513"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Control location url: "localhost:40441"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Status location null
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Pipeline options {"beam:option:allow_non_deterministic_key_coders:v1":false,"beam:option:allow_non_restored_state:v1":false,"beam:option:allow_unsafe_triggers:v1":false,"beam:option:app_name:v1":null,"beam:option:artifact_port:v1":"0","beam:option:auto_balance_write_files_sharding_enabled:v1":false,"beam:option:beam_services:v1":{},"beam:option:block_on_run:v1":true,"beam:option:dataflow_endpoint:v1":"https://dataflow.googleapis.com","beam:option:direct_embed_docker_python:v1":false,"beam:option:direct_num_workers:v1":"1","beam:option:direct_runner_bundle_repeat:v1":"0","beam:option:direct_runner_use_stacked_bundle:v1":true,"beam:option:direct_running_mode:v1":"in_memory","beam:option:direct_test_splits:v1":{},"beam:option:disable_metrics:v1":false,"beam:option:dry_run:v1":false,"beam:option:enable_artifact_caching:v1":false,"beam:option:enable_hot_key_logging:v1":false,"beam:option:enable_streaming_engine:v1":false,"beam:option:enforce_encodability:v1":true,"beam:option:enforce_immutability:v1":true,"beam:option:environment_cache_millis:v1":"0","beam:option:environment_config:v1":"localhost:44379","beam:option:environment_type:v1":"LOOPBACK","beam:option:expansion_port:v1":"0","beam:option:experiments:v1":["beam_fn_api"],"beam:option:externalized_checkpoints_enabled:v1":false,"beam:option:fail_on_checkpointing_errors:v1":true,"beam:option:faster_copy:v1":false,"beam:option:finish_bundle_before_checkpointing:v1":false,"beam:option:flink_conf_dir:v1":null,"beam:option:flink_job_server_jar:v1":"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.45.0-SNAPSHOT.jar","beam>:option:flink_master:v1":"[auto]","beam:option:flink_submit_uber_jar:v1":false,"beam:option:flink_version:v1":"1.15","beam:option:gcp_oauth_scopes:v1":["https://www.googleapis.com/auth/bigquery","https://www.googleapis.com/auth/cloud-platform","https://www.googleapis.com/auth/devstorage.full_control","https://www.googleapis.com/auth/userinfo.email","https://www.googleapis.com/auth/datastore","https://www.googleapis.com/auth/spanner.admin","https://www.googleapis.com/auth/spanner.data"],"beam:option:gcs_performance_metrics:v1":false,"beam:option:hdfs_full_urls:v1":false,"beam:option:job_name:v1":"BeamApp-jenkins-0108014105-e7a442a0","beam:option:job_port:v1":"0","beam:option:job_server_java_launcher:v1":"java","beam:option:job_server_jvm_properties:v1":[],"beam:option:job_server_timeout:v1":"60","beam:option:load_balance_bundles:v1":false,"beam:option:max_parallelism:v1":"-1","beam:option:no_auth:v1":false,"beam:option:object_reuse:v1":false,"beam:option:options_id:v1":2,"beam:option:output_executable_path:v1":null,"beam:option:parallelism:v1":"-1","beam:option:performance_runtime_type_check:v1":false,"beam:option:pickle_library:v1":"default","beam:option:pipeline_type_check:v1":true,"beam:option:profile_cpu:v1":false,"beam:option:profile_memory:v1":false,"beam:option:profile_sample_rate:v1":1,"beam:option:project:v1":"apache-beam-testing","beam:option:re_iterable_group_by_key_result:v1":false,"beam:option:requirements_cache_only_sources:v1":false,"beam:option:resource_hints:v1":[],"beam:option:retain_docker_containers:v1":false,"beam:option:retain_externalized_checkpoints_on_cancellation:v1":false,"beam:option:runner:v1":null,"beam:option:runner_determined_sharding:v1":true,"beam:option:runtime_type_check:v1":false,"beam:option:s3_disable_ssl:v1":false,"beam:option:save_main_session:v1":false,"beam:option:sdk_harness_log_level_overrides:v1":{"org.apache.beam.runners.flink.FlinkPipelineRunner":"WARN","org.apache.flink.runtime":"WARN","org.apache.flink.runtime.metrics.groups":"ERROR"},"beam:option:sdk_location:v1":"container","beam:option:sdk_worker_parallelism:v1":"1","beam:option:spark_master_url:v1":"local[4]","beam:option:spark_submit_uber_jar:v1":false,"beam:option:spark_version:v1":"3","beam:option:streaming:v1":false,"beam:option:temp_location:v1":"gs://temp-storage-for-end-to-end-tests/temp-it","beam:option:type_check_additional:v1":"","beam:option:type_check_strictness:v1":"DEFAULT_TO_ANY","beam:option:update:v1":false,"beam:option:use_storage_api_connection_pool:v1":false,"beam:option:use_storage_write_api:v1":false,"beam:option:use_storage_write_api_at_least_once:v1":false,"beam:option:verify_row_values:v1":false}
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED                                                                   [100%]

=============================== warnings summary ===============================
Exception in thread read_grpc_client_inputs:
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43797 {created_time:"2023-01-08T01:38:04.950119432+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-flink-py37.xml> -
=================== 7 passed, 1 warning in 241.88s (0:04:01) ===================
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33427 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2023-01-08T01:41:27.195804991+00:00"}"
>


> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz> --requirements_file=postcommit_requirements.txt --num_workers=1 --sleep_secs=20 --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=spannerio_it
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, hypothesis-6.61.3, requests-mock-1.10.0
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15] / gw7 [15]

scheduling tests via LoadFileScheduling

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
[gw1] SKIPPED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update 
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 
[gw0] PASSED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call 
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw0] SKIPPED apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call 
[gw1] PASSED apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches 

=============================== warnings summary ===============================
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117: FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
  <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135: FutureWarning: WriteToSpanner is experimental. No backwards-compatibility guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml> -
=========== 5 passed, 16 skipped, 14 warnings in 2210.72s (0:36:50) ============

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 111

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 4h 46m 1s
213 actionable tasks: 149 executed, 58 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/cxw5pmlspsyig

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org